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Table 1.4.1. TPA Documentation Requested and Reviewed 


Documentation Provided by Model Representatives 
FAST edTPA CalTPA 


Documentation Requested 


Documentation of changes to the 
assessment tasks and/or to the 
scoring rubrics and associated 
program, candidate, and scoring 
materials. 


- Update on the Redevelopment 
of the Fresno Assessment of 
Student Teachers (i.e., FAST2 
Transition Plan and FAST 
Transition Plan revised 8/3/17) 


Request for Commission 
Authority to Waive the 
Professional Preparation 
Requirement for Candidates 
Participating in the FAST Field 
Test. 


Fresno Assessment of Student 
Teachers: FAST 2.0 Changes: 
Response to Assessment 
Design Standards (March 2018 
& May 2018) 


FAST PowerPoint slides 
presented at TAC meeting on 
11/16/17 


FAST Response to Assessment 
Design Standards (5/31/18) 


FAST v2.0 Complete Manual 


- edTPA Transition Plan 
03.02.2017.pdf 


- edTPA PowerPoint slides 
presented at TAC meeting 
on 11/16/17 


- edTPA Transition Plan 
Update_May 2018.pdf. 


- CalTPA Program Summary 
Timeline_8.22.17.pdf 


TPA-Assessment-Design-Standards 
Table for 
Validity_Draft_100716.docx 


CalTPA PowerPoint slides 
presented at TAC meeting on 
11/16/17 


Update on the Redevelopment of the 
California Teaching Performance 
Assessment.pdf (June 2017 and 
August 2018) 


Program Implementation 
Presentations (downloaded from 
website) 


Program Implementation Resources 
(downloaded from website) 


CalTPA Design Team Meeting 
Materials (downloaded from website) 


Bilingual Candidates and the 
CalTPA 


CalTPA_TPE_Mapping_OP 
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Table 1.A.1. (Continued) 


Documentation Requested 


Most recent annual report 
submitted to the Commission 


User manual/handbook for teacher 
candidates 


Documentation Provided by Model Representatives 
FAST edTPA “CalTPA 


Not being requested by the 
Commission at this time 


FASTv2.0 Complete Manual.pdf 


FAST Candidate Resources 
Sp18.pdf 


FAST Candidate Support 
Table.pdf 


FAST TSP SS candidate 
overview.pptx 


- Not being requested by the 
Commission at this time 


- Not being requested by the 
Commission at this time 


edTPA Bi-annual summary from 
2016-2017 year (7/2017 release) 


CA state summary and National 
summary see CA file: 
rtpaCA_admin- 
edTPA_Summary_Reports_ State 
_2016JUL-2017JUN.pdf 


National file: rtpaCA_admin- 
edTPA_Summary_Reports_Natio 
nal_2016JUL-2017JUN.pdf 
edTPA Handbooks CalTPA_AssessmentGuide_MS 
Cycle 1.pdf 


- CalTPA_AssessmentGuide_MS 
Cycle 2.pdf 


- CalTPA 
AssessmentGuide_SS_Cycle 
1.pdf 


- CalTPA 
AssessmentGuide_SS_Cycle 
2.pdf 
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Table 1.A.1. (Continued) 


Documentation Provided by Model Representatives 
Documentation Requested FAST edTPA CalTPA 


User manual/handbook for 
programs/faculty 


- FASTv2.0 Complete 
Manual.pdf 


- FAST orientation.ppt 


Technical Manual - Appendix G of FAST 
Response to Assessment 
Design Standards 


Test specifications/test blueprint - Teaching Performance 
Expectations (Multiple and 
Single Subject): FAST 
Tasks Matrix 


- edTPA Handbooks 


Making Good Choices (see file: 
edtpa Making Good Choices.pdf) 


edTPA Program Support site 
(http://edtpa.aacte.org/) 


edTPA.com Faculty -page 
http:/Awww.edtpa.com/PageView.as 
px?f=GEN_Faculty.html) 


Guidelines for supporting 
candidates (see file: edtpa- 
guidelines-for-acceptable- 
candidate-support-2016-final.pdf) 


Understanding Rubric Level 
Progressions (URLPs) 


Admin Reports here: 
https://secure.aacte.org/apps/rl/resou 
rce.php?resid=647 &ref=edtpa 


edTPA Transition Plan 
03.02.2017.pdf 


see file: edTPA technical 
specifications.docx 


see TPEs measured by ed TPA 
rubrics. pdf 


edTPA Transition Plan 
03.02.2017.pdf 


CalTPA_AssessmentGuide_MS 
Cycle 1.pdf 


CalTPA_AssessmentGuide_MS 
Cycle 2.pdf 


CalTPA 
AssessmentGuide_SS_ Cycle 1.pdf 


CalTPA 
AssessmentGuide_SS_ Cycle 2.pdf 


CalTPA Program Workshop_Oct 
25 Agenda.pdf 


CalTPA Program Workshop_Oct 
25 Gallery Notes.pdf 


CalTPA Program Workshop Oct 
25_No video.ppt 


CalTPA_Templates.zip 

The templates, assessment guides 
and Candidate and Faculty 
supports on www.ctcpa.nesinc.com 
CalTPA_FT_TPE Map.pdf 


CalTPA_TPE_Mapping_OP.pdf 
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Table 1.A.1. (Continued) 


Documentation Requested 


Procedures for administering 
assessments 


Documentation of content, bias, 
sensitivity, and fairness reviews 
and edits 


Sample candidate score report 


Sample program score report 


Documentation Provided by Model Representatives 
FAST edTPA CalTPA 


- FASTv2.0 Complete 
Manual.pdf 


- FAST Response to 
Assessment Design 
Standards (Appendix F) 


- FAST Assessor Guidelines 
2018.pdf 


- FAST Bias Training 
Sp18.pdf 


- FAST Supervisor Scorer 
Training Table.pdf 


- FAST Candidate Score 
Reports 


- TSP Report of Scores2.0 


- Not applicable 


- edTPA handbooks 


Registration: 
http://www.edtpa.com/Content/Docs/e 
dTPARegistrationOverview.pdf 


Building the portfolio: 
http://www.edtpa.com/PageView.aspx 
?f=GEN_Prepare.html 


FT Summary report here: 
https://secure.aacte.org/apps/rl/res_g 
et.php?fid=827 &ref=edtpa 


edTPA Scoring - Bias Training 
Module.pdf 


Global Handbook Bias Report.doc 
Orientation Manual FINAL.pdf 


edTPA Transition Plan 
03.02.2017.pdf 


Interpreting your edTPA score profile 
here: 
http://www.edtpa.com/Content/Docs/e 
dTPA_InterpretingYourProfile. pdf 


Educator Preparation Program (EPP) 
reporting is described here: 
http://www.edtpa.com/PageView.aspx 
?f=GEN_edTPAReporting.html 


EPP file layout here: 
http://www.edtpa.com/Content/Docs/e 
dTPA_InstitutionReportLayout.pdf 


- See information/policies on 
www.ctcpa.nesinc.com 


- Performance Assessment Guides 


CalTPA_CEPFeedback_Report.docx 


- CalTPA BRC Bias Action 
Summary_20161018.doc 


CalTPA_FT_BRC Bias Action 
Summary_20170918.doc 


TPA_OP_BRC_Instructions.pdf 


CalTPA_2018 BRC_Orientation.ppt 


- CalAPA- 
TPA_OP_BRC_Instructions.pdf 


CalTPA Teacher Candidate 
Assessment Results Report 


CalTPA Supplemental Materials: 
Assessment Results Report 


CalTPA Teacher Candidate 
Assessment Results Report 
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Table 1.A.1. (Continued) 


a Documentation Provided by Model Representatives 
Documentation Requested FAST edTPA CalTPA 


- 2019-06-2d_CalTPA Standard 
Setting Agenda Item.pdf 


- FAST Response 5-31- - FT Summary report here (see 
National Standard Setting): 


Information on standard-setting 
and on developing performance 18.pdf 
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level descriptors 


https://secure.aacte.org/apps/rl/res 
_get.php?fid=827 &ref=edtpa 


Description of National 
Recommended Professional 
Performance Standard here: 
http:/Awww.edtpa.com/PageView.a 
spx?f=GEN_PerformanceStandard 
-html 


Description of California’s passing 
standard: 
https://www.edtpa.com/PageView. 
aspx?f=GEN_California.html 


https://www.ctc.ca.gov/docs/default 
source/commission/agendas/2014- 
10/2014-10-3f-pdf.pdf?sfvrsn=0 


edTPA Transition Plan 
03.02.2017.pdf 


- 2019-06-2d-CalTPA Standard 
Setting appendix.pdf 
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- FAST Response 5-31- 
18.pdf 


Scoring Information 


- FAST Assessor 
Guidelines.pdf 


- FAST Bias Training 
Sp18.pdf 


- FAST Supervisor Scorer 
Training Table.pdf 


- edTPA Training Improvement 
Timeline_Final.doc 


TBR and URLP 
http://scoreedtpa.pearson.com/ 
Tech Reports 
(https://secure.aacte.org/apps/rl/re 


source.php?resid=64 7 &ref=edtpa) 


edTPA OP19 Quality Management 
Plan (QMP) 


edTPA Transition Plan 
03.02.2017.pdf 


- CalTPA Scoring QMP_v2 
CalTPA_2018 BRC_Orientation.ppt 
CalAPA-TPA_OP_BRC_Instructions 
How to look at score data: 
https://www.ctcexams.nesinc.com/ 
content/docs/CalTPA_VTT_Februa 
ry_2019 Slides.pdf 

Assessor Survey data (2018-19) 


CalTPA Revised Pilot Scoring 
Manual 04182017.docx 


CalTPA Scoring Session 
Agenda_v2.docx 


CalTPA Scoring_Program 
Overview.ppt 


CalTPA_Submission 
Review_Cycle 1_ROE_v2.docx 


CalTPA_Submission 
Review_Cycle 2_ ROE_v2.docx 


Preventing Bias_Performance 
Assessents.ppt 


Pilot Rubric Placemats.zip 
CalTPA_Feild Test Scoring_Cycle 
1 Assessor 

Training _MS_3.22.18.pdf 
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Table 1.A.1. (Continued) 


_Documentation Requested 


| Documentation Provided by Model Representatives 
FAST sd edTPA CalTPA 


- Cycle 1 Assessor Training Prep 
Homework 


CalTPA Cycle 2 Agenda.pdf 


CalTPA Cycle 2 ELA PreWork 
Consesnsus Sample Lead 
Assessor Notes.pdf 


CalTPA Cycle 2 MS Literacy 
PreWork Consensus Sample Lead 
Assessor Notes.pdf 


-CalTPA Steps for Determining 
Rubric Scores.pdf 


CalTPA_DailyScoringMgmt_Sampl 
e for HumRRO.xIs 

Update on the Redevelopment of 
the California Teaching 
Performance Assessment.pdf 


CalTPA Design Team Meeting 
PowerPoint_July 2018 _final.ppt 


Score report information 


https://www.edtpa.com/PageView. 
aspx?f=GEN_Scores.html 
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Table 1.A.1. (Continued) 


Documentation Provided by Model Representatives 
Documentation Requested FAST edTPA CalTPA 


Test retake/appeal - FASTv2.0 Complete - Retaking edTPA: - Update on the Redevelopment of the 


seaipuaddy :]] awinjon — S[apOW Wd_L {0 Ayiqesedwioy jo uojebiysanul 


6V'L 


Manual.pdf 


- FAST Response 5-31- 
18.pdf 


- FAST Response 5-31- 
18.pdf 


Validity, reliability, and fairness 
studies for the updated 
assessment 


- FAST Response 5-31- 
18.pdf 


Quality Control procedures 


- (additional relevant 
materials listed above) 


http:/www.edtpa.com/PageView.aspx 
?f=GEN_RetakingedTPA.html 


- Appeal Process (Requesting a score 


confirmation): 
http:/Awww.edtpa.com/PageView.aspx 
?f=GEN_RequestingAScoreConfirmat 
ion.html 


Retake policy: 
http:/Awww.edtpa.com/PageView.aspx 
?f=GEN_CandidatePolicies.html 


- edTPA Transition Plan 


03.02.2017. pdf 


- edTPAScoringQMP_Fall2017_DRAF 


T_9.29.2017.docx 


- edTPA Training Improvement 


Timeline_Final 


(additional relevant materials listed 
above) 


California Teaching Performance 
Assessment.pdf 


Appeal Process (Requesting a score 
verification): 


https://www.ctcexams.nesinc.com/Pa 
geView.aspx?f=GEN_RequestingARe 
score.html 


Summary of HumRRO TPE Validity 
Study presented to Commission in 
June 2016: 


https://www.ctc.ca.gov/docs/default- 
source/commission/agendas/2016- 
06/2016-06-2b- 
pdf.pdf?sfvrsn=beb9009e_0 


TPA Assessment Design Standards 
Table for Validity (dated 10/7/16) 


CalTPA Scoring QMP_v2 

Update on the Redevelopment of the 
California Teaching Performance 
Assessment.pdf (August 2018) 


CalTPA Design Team Meeting 
PowerPoint_July 2018 _final.ppt 


(additional relevant materials listed 
above) 
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Chapter 3. Appendices 
Appendix 3.A: FAST Candidate Survey 


Table 3.4.1. FAST SVP: Please rate your level of agreement with each of the following 
statements 


Don't 
know/ 
Strongly Strongly | Does not 
Disagree Disagree Agree apply 
Question (C75) (%) (%) (%) 
Overall, the directions for the SVP were 2A 11.0 56.1 293 12 
easy to understand. 
The form templates (class profile, 
activity/strategy table, self-evaluation of 
lesson) for the SVP helped me prepare ae at ae oe ie 
my submission. 
| understood what was expected in the 
reflection for the SVP. oe eel ese ale oe 
| understood what | was asked to submit 
as evidence for the SVP. 2 i 40:2 48.8 12 
The four levels of performance were 0.0 73 A15 50.0 12 
clearly stated in the rubrics. 
The rubrics helped me in preparing my 37 61 46.3 42.7 12 
submission. 


Table 3.4.2. FAST TSP: Please rate your level of agreement with each of the following 
statements 


Don't know/ 
Strongly Strongly Does not 


Disagree Disagree | Agree Agree apply 
Question | 07) Leap =e) || 07) | 07) 


Overall, the directions for the TSP were 


easy to understand. 3.7 23.5 40.7 32.1 0.0 


| understood what was expected in the 
commentary (e.g., responses to 4.9 14.8 48.1 32.1 0.0 
questions and reflections) for the TSP. 


| understood what | was asked to 


submit as evidence for the TSP. 29 A sue sien ee 

The four levels of performance were 12 99 45.7 43.2 00 
clearly stated in the rubrics. . : . : : 

The rubrics helped me in preparing my 25 7A 53.1 37.0 0.0 


submission. 
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Table 3.A.3. FAST Resources: Please rate your level of satisfaction with the FAST Tk20 
online system 


Not Very iN Lo) 


Helpful 
Question (C5) 


Somewhat Helpful Opinion 
Helpful (%) (6) (%) 


Please rate your level of satisfaction with 
the FAST Tk20 online system used for 
uploading submissions. 


48.8 39.0 


Table 3.4.4. FAST: Please rate your level of agreement with each of the following 
statements 


Don't know/ 
Siivelarel iV S)ivelare hz Does not 
Disagree | Disagree | Agree Agree Feo) 0) NV 
Question 07) 67) 07) 02) 07) 


The FAST Manual guidance provided 
sufficient information to assist me 3.7 
throughout the process. 


13.6 56.8 18.5 74 


Table 3.4.5. FAST SVP: Please rate your level of agreement with the following statements 


Strongly 


Disagree 
Question (%) OZ) 


Disagree 


Overall, the SVP provided me sufficient 


opportunity to demonstrate my instructional 1.2 12.2 46.3 39.0 1.2 
knowledge, skills, and abilities. 

The teaching knowledge, skills, and 

abilities assessed in the SVP are 1.2 74 45.7 43.2 2.5 


emphasized in my preparation program. 


Table 3.4.6. FAST TSP: Please rate your level of agreement with the following statements 


Don't know/ 
Strongly Strongly | Does not 
Disagree | Disagree apply 
Question (%) (C5) (%) 
Overall, the TSP provided me sufficient 
opportunity to demonstrate my instructional 118) 77 42.3 46.2 2.6 
knowledge, skills, and abilities. 
The teaching knowledge, skills, and 
abilities assessed in the TSP are 2.4 11.0 43.9 41.5 1.2 
emphasized in my preparation program. 
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Appendix 3.B: ed TPA Candidate Survey 


Table 3.B.1. eaTPA Task 1: Please rate your level of agreement with the following 
statements 


Don't know/ 
Strongly Strongly | Does not 


Disagree Disagree Agree apply 
Question (%) (C5) (%) 67) 


Overall, the directions for this task 13.6 265 ATA 11.8 07 
were easy to understand. 


The “Context for Learning” form for 


this task helped me prepare my 9.9 29.8 43.4 15.4 1.5 
submission. 
| understood what was expected in 10.3 26.4 50.2 125 07 


the commentary for this task. 


| understood what | was asked to 
submit as evidence for this task. ae 14 an0 Sd. ua 


The five levels of performance were 99 18.7 52.0 17.9 15 
clearly stated in the rubrics. 


The rubrics helped me in preparing 77 176 48.7 25.6 0.4 
my submission. : : . : : 


Table 3.B.2. edTPA Task 2: Please rate your level of agreement with the following 
statements 


Don't know/ 
Strongly Strongly Does not 


Disagree Disagree Agree apply 
Question (%) (C75) (%) (%) 


Overall, the directions for this task 12.7 262 47.7 123 12 
were easy to understand. 


understood what was expected 10.0 23.1 527 13.1 12 
in the commentary for this task. 


| understood what | was asked to 
submit as evidence for this task. fel! whe 58.3 Ae a 


The five levels of performance 77 20.4 53.1 173 15 
were Clearly stated in the rubrics. 


The rubrics helped me in 10.8 15.0 51.2 22.7 0.4 
preparing my submission. 
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Table 3.B.3. edATPA Task 3: Please rate your level of agreement with the following 


statements 
Don't know/ 
Strongly Strongly Does not 
Disagree Disagree Agree apply 
Question (0) (OZ) (%) (%) 
Overall, the directions for this task 10.2 256 516 118 08 
were easy to understand. 
understood what was expected 94 252 52.4 126 0.8 
in the commentary for this task. 
| understood what | was asked to 
submit as evidence for this task. (lo oe eee ie cS 
The five levels of performance 83 19.7 53.9 16.9 12 
were clearly stated in the rubrics. 
Mit ile alesse) 9.5 15.5 528 | 21.0 1.2 
preparing my submission. 


Table 3.B.4. edTPA Resources: Please rate your level of satisfaction with each of the 
following resources 


Not Helpful Somewhat Very i Coe) ol al Col alm PIL] 

Resources (%) Helpful (%) Helpful (%) not use (%) 
Making Good Choices 13.9 48.0 29.1 9.0 
Understanding Rubric Level 15.2 40.2 40.6 A 
Progressions 
Peademle Eangtage 18.6 45.9 25.2 10.3 
Handouts 
Candidate registration 272 46.5 152 44.4 


website (edTPA.com) 


Table 3.B.5. edTPA: Please rate your level of agreement with each of the following 

statement 

| Don't know/ 
Does not 


apply 
(7) 


Siivelatel iV 
Agree 
2) 


S)ivelare hz 


Disagree 
(%) 


Disagree 
(%) 


Agree 
(%) 


Question 


The Handbook and templates provided 


sufficient information to assist me 12.2 22.0 44.5 20.4 0.8 
throughout the assessment process. 
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Table 3.B.6. edTPA Task 1: Please rate your level of agreement with each of the following 


statements 


Question 


Strongly 
Disagree 
(%) 


Disagree 


(%) 


Strongly | Does not 


Overall, Task 1 (Planning) provided me 
sufficient opportunity to demonstrate my 


knowledge, skills, and abilities related to eel es ate ico OS: 
planning. 

The pedagogical and content knowledge, 

skills, and abilities assessed in Task 1 10.5 414.7 523 24.4 14 


(Planning) are emphasized in my 
preparation program. 


Table 3.B.7. edTPA Task 2: Please rate your level of agreement with each of the following 


statements. 


Question 


Overall, Task 2 (Instruction) provided me 


Strongly 
Disagree 
(%) 


Disagree 


(%) 


Strongly 
Agree 


(%) 


Don't 
know/ 


Does not 


apply 
(%) 


(Instruction) are emphasized in my 
preparation program. 


sufficient opportunity to demonstrate my 14.0 26.4 48.8 10.5 0.4 
instructional knowledge, skills, and abilities. 

The pedagogical and content knowledge, 

skills, and abilities assessed in Task 2 82 15.6 53.1 223 08 


Table 3.B.8. edTPA Task 3: Please rate your level of agreement with each of the following 


statements 
Don't 
know/ 
Strongly Strongly | Does not 
Disagree Disagree Agree Te) oh 
Question (%) (%) (C5) (C5) 
Overall, Task 3 (Assessment) provided 
me sufficient opportunity to demonstrate 
my knowledge, skills, and abilities related ne ele ee BY ue 
to assessment. 
The pedagogical and content knowledge, 
skills, and abilities assessed in Task 3 95 18.2 48.2 23.3 08 
(Assessment) are emphasized in my 
preparation program. 
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Appendix 3.C: CalTPA Candidate Survey 


Table 3.C.1. CalTPA: Please rate your level of agreement with the following statement 


Don't know/ 
Siivelatel iV Siivelarel iy Does not 


Disagree Disagree | Agree Agree apply 
Question (%) 07) 0/)) 0779) 079) 


Overall, | had a clear understanding of 13.7 278 43.5 44.1 1.0 
CalTPA requirements. 


Table 3.C.2. CalTPA Resources: Please rate the helpfulness of each of the following 
resources 


Not Very 
Helpful Somewhat Helpful | was not aware of 
Resources (629) Helpful (%) (629) this resource (%) 
Website resources for reviewing 
general information about the CalTPA 12.9 5515) 25.5 6.1 
including materials and policies 
Website resources for video recording 16.5 43.7 26.2 13.6 
(“Tips and Tools”) 
Website resources for video upload 14.4 45.4 30.1 10.1 
Website resources for using the 116 43.9 277 16.8 
ePortfolio system 
The ePortfolio upload and submission 113 43.0 39.5 61 
system 
The ePortfolio video annotation tool 11.3 45.5 38.1 5.2 
The registration system 11.0 50.2 35.9 2.9 
CalTPA support services (e.g., FAQs, 17.7 32.9 20.0 29.4 
Customer Support) 


Table 3.C.3. CalTPA Resources: Please rate your level of agreement with the following 
statement 
Siivelarel iV Strongly | was not aware 


Disagree Disagree | Agree Agree of this resource 
Question (%) en &)) (%) | 07) | 07) 


The Performance Assessment 76 15.2 50.0 247 25 
Guides were helpful. 
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Table 3.C.4. CalTPA: Please rate your level of agreement with each of the following 


statements 
Don't know/ 
Strongly Siivelatel iV Does not 
Disagree Disagree | Agree Agree FeV 0) 0) NV 
Question 079) 0779) 079) 079) 67) 
The CalTPA assesses the 
knowledge, skills, and abilities 7A 14.7 59.8 176 06 
emphasized in my preparation 
program. 


3.C-16 
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Appendix 3.D: Coordinator Surveys 


Table 3.D.1. Coordinators: Please rate your level of agreement with each of the following 
statements 


Don't know/ 
Siivelarel iy S)ivelare hz Does not 
Disagree | Disagree Agree FeTeye) Ny 
Question (C29) (C9) (629) (%) 
FAST: After reviewing supporting 
materials, | had a clear understanding of 
FAST’s purposes before | began assisting Ne oe Che pare aay 
candidates. 


edTPA: After reviewing supporting 
materials, | had a clear understanding of 
the edTPA’s purposes before | began a5 oe ae0 429 “a 
assisting candidates. 


CalTPA: After reviewing all support 
materials, | had a clear understanding of 
the CalTPA’s purposes before | began one oo a ale — 
assisting candidates. 


FAST: After reviewing supporting 
materials, | had a clear understanding of 
FAST’s requirements before | began a0 ce = onW oe 
assisting candidates. 


edTPA: After reviewing supporting 
materials, | had a clear understanding of 
the edTPA’s requirements before | began on Bee orate See ose 
assisting candidates. 


CalTPA: After reviewing all support 
materials, | had a clear understanding of 
the CalTPA’s requirements before | began oe pe0 one one 22 
assisting candidates. 


Table 3.D.2. Coordinators: Please rate your level of agreement with each of the following 
statements 


Don't know/ 
Siielarel iy Strongly Does not 
Disagree | Disagree Agree apply 
Question 079) 079) 0779) 0779) 
FAST: Overall, | was well informed during 
the implementation process. ue oe a of 0.0 
edTPA: Overall, | was well informed during 
the process of assisting candidates. a == B18 zoe 
CalTPA: Overall, | was well-informed about 
the CalTPA. 0.0 8.7 58.7 30.4 2.2 
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Table 3.D.3. Coordinators: Please rate your level of agreement with each of the following 
statements 


Don't 
know/ 
Siivelarel iV S)ivelare | Does not 


Disagree | Disagree Agree FeV 0) 0) WV 
Question (%) (C29) (O29) (629) 


FAST: Resources, orientations, and 
seminars provided me with sufficient 0.0 5.9 51.0 43.1 0.0 
information to assist candidates. 


edTPA: The website supports for 
accessing information about edTPA, 
including the test overview, materials, and 9.5 19.0 47.6 23.8 0.0 
policies, were valuable to me as | prepared 
for my responsibilities. 


CalTPA: The webinars were valuable to 
me as | prepared for my CalTPA 0.0 4.3 63.0 19.6 13.1 
responsibilities. 


CalTPA: The “Office Hours” sessions were 
valuable to me as | prepared for my 2.2 13.0 39.1 13.0 32.6 
CalTPA field test responsibilities. 


CalTPA: The “Virtual Think Tank” sessions 
were valuable to me as | prepared for my 2.2 6.5 45.7 21.7 23.9 
CalTPA field test responsibilities. 


CalTPA: The “Program Updates” online 
sessions were valuable to me as | 
prepared for my CalTPA field test 

responsibilities. 


CalTPA: The in-person CalTPA Program 
workshop in Riverside was valuable to me 
as | prepared for my CalTPA field test 
responsibilities. 


CalTPA: The in-person CalTPA Program 

workshop in Sacramento was valuable to 

me as | prepared for my CalTPA field test 
responsibilities. 


2.2 2.2 34.8 39.1 21.7 


0.0 9.1 29.5 20.5 40.9 


2.3 2.3 15.9 18.2 61.4 


CalTPA: The CalTPA page on the CTC 
assessments website provided valuable 0.0 8.9 46.7 37.8 6.6 
information. 


CalTPA: The CalTPA EPP Support 
Mailbox was a valuable resource when | 2.2 6.5 28.3 10.9 52.2 
had a question. 
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Table 3.D.4. Coordinators: Please rate your level of agreement with each of the following 
statements 
Don't 
know/ 


Siicelatel iV Strongly Does not 
Disagree | Disagree | Agree Agree FeV 0) 0) WV 
Question 07) 07) 07) 07) 07) 


CalTPA: The CalTPA focuses on the 
appropriate skills and practices necessary 0.0 2.1 58.3 39.6 0.0 
for beginning teachers. 


FAST: FAST focuses on the appropriate 
skills and practices necessary for 0.0 3.9 37.3 58.8 0.0 
beginning teachers. 


edTPA: The edTPA focuses on the 
appropriate skills and practices necessary 0.0 0.0 76.2 23.8 0.0 
for beginning teachers. 


CalTPA: The CalTPA assesses the 
knowledge, skills, and abilities emphasized 0.0 2.1 66.7 31.3 0.0 
in our preparation program. 


FAST: FAST appropriately assesses 
candidate readiness in the areas 2.0 5.9 37.3 52.9 2.0 
measured. 


edTPA: The edTPA appropriately 
assesses candidate readiness in the areas 0.0 19.0 61.9 19.0 0.0 
measured. 
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Chapter 4. Appendices 
Appendix 4.A: In-Person Marker Selection Data Collection Instrument 


HumRRO observers will conduct themselves as unobtrusive observers during scoring events 
(e.g., Marker Selection, Assessor Training & Calibration). Generally, one staff member will 
attend any given event. The staff member will introduce him/herself to lead facilitators, explain 
his/her role, and ask where best to position themselves during the observation. S/he will ask the 
facilitator to please speak up if the observer seems to be making anyone uncomfortable or is 
interfering in the scheduled process in any way. Ideally, the observer would have sufficient desk 
space for a computer and notepad, and access to power. 


The observer will: 


e Receive a copy of non-proprietary handouts; 

e With permission of the facilitator(s), move around the room periodically to more 
thoroughly observe activities; 

e Take notes during the event; 

e Complete an event-specific checklist either during or after the event; 

e Conduct informal interviews of a small number of attendees during breaks, if feasible; 
and 

e Conduct a brief interview with the facilitator(s) after the event. 


The observer will not: 
e Answer any technical questions from attendees; rather the observer will refer the 


attendee to a facilitator; 
e Offer any evaluative feedback at the event. 
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Table 4.A.1. Marker Selection Instrument 


Aspects (Assessment Design Standard where applicable) 


1. The model sponsor selects personnel for marker selection with a deep 
understanding of the TPEs, the pedagogical assessment tasks, and the 
multi-level scoring rubrics. (Based on ADS 2c) 

2. Adocumented process exists to train personnel to conduct marker 
selection. 


Marker selection training includes an appropriate amount of practice. 


Marker selection training provides time for discussion of the process 
and questions by those undertaking the activity. 


A process is in place to monitor and review marker selection decisions. 


Efforts are taken within the marker selection process to minimize the 
effects of candidate factors that are not clearly related to pedagogical 
competence, which may include (depending on the circumstances) 
factors such as personal attire, appearance, demeanor, speech 
patterns and accents or any other bias that are not likely to affect job 
effectiveness and/or candidate learning. (Based on ADS 1h) 

7. Where appropriate, a wide range of pedagogical practices that are 
educationally effective are reflected in marker selection. (Based on ADS 
1c) 

8. Marker selection emphasizes entry-level pedagogical competence to 
teach the curriculum and student population of California’s TK-12 
public schools. (Based on ADS 1n) 

9. Interview only: Are the rubrics clear and do they provide enough detail 
to select markers? 
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Table 4.B-1 presents our checklist for general training procedures. 


Appendix 4.B: In-Person Scoring and Calibration Data Collection Instrument 


Table 4.B.1. General Training Procedures Checklist 


Checklist Item (Assessment Design Standard where applicable) Notes (Include whether observed or documented) 


1. 
2. 


10. 


Use of markers in conjunction with the scoring guide emphasized. 


Rater biases addressed. Raters must remember to set aside 
personal biases and utilize the training materials in making 
scoring decisions. 


Purpose of various training sets explained. 
Scorers have ample practice material. 


Practice material is discussed. 


Distinctions are made between scoring procedures for pilot/field 
test and operational candidate submissions (e.g., use of pair and 
group scoring). 


An assessor training program demonstrates convincingly that 
prospective assessors gain and continuing assessors have and 
maintain a deep understanding of the TPEs. (ADS 2c) 


An assessor training program demonstrates convincingly that 
prospective assessors gain and continuing assessors have and 
maintain a deep understanding of the pedagogical assessment 
tasks. (ADS 2c) 


An assessor training program demonstrates convincingly that 
prospective assessors gain and continuing assessors have and 
maintain of the multi-level scoring rubrics. (ADS 2c) 


The training program includes task-based scoring trials in which 
an assessment trainer evaluates and certifies each assessor's 
scoring accuracy and calibration in relation to the scoring rubrics 
associated with the task. (ADS 2c) 


(continued) 


qe 


341 SADUNOSSY NYY 


OddUUNH 


seolpuaddy :]/] awinjoAn — S[apoW Wd_L {0 Ayiqesedwioy jo uojebiysanul 


€c-av 


Table 4.B.1. (Continued) 
Checklist Item (Assessment Design Standard where applicable) Notes (Include whether observed or documented) 


11. When new pedagogical tasks and scoring rubrics are incorporated 
into the assessment, the model sponsor provides additional training 
to the assessors, as needed. (ADS 2c) 


12. Were there any changes to scoring guides, marker papers, or 
practice sets during scoring? 


13. The model sponsor develops assessor training procedures that 
focus primarily on teaching performance and that minimize the 
effects of candidate factors that are not clearly related to 
pedagogical competence, which may include (depending on the 
circumstances) factors such as personal attire, appearance, 
demeanor, speech patterns and accents or any other bias that 
are not likely to affect job effectiveness and/or student learning. 
(Based on ADS 1h) 


Table 4.B.2 displays checklist performances and findings related to our review of performance and task presentation to raters and 
coverage of performance intent and context. 


Table 4.B.2. Opportunity to View Performance/Task and Performance Intent Checklist 


Checklist Item Notes (Include whether observed or documented) 


1. Scorers score qualifying set(s) independently. 
2. Discussion uses the language of the scoring guide/rubric. 


3. All responses in the qualifying set(s) are 
discussed/reviewed/available. 


4. Conduct additional training for all scorers using recalibration or 
refresher after any sustained break in scoring (e.g., lunch), or at 
the discretion of the trainer (e.g., if reliability is too low overall). 


5. The model sponsor uses only assessors who successfully 
calibrate during the required TPA model assessor training 
sequence. (ADS 2c) 
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Table 4.B.3 presents calibration procedures. 


Table 4.B.3. Calibration Procedures 


Checklist Item Notes (Include whether observed or documented) 


1. Scorers score qualifying set(s) independently. 
2. Discussion uses the language of the scoring guide/rubric. 


3. All responses in the qualifying set(s) are 
discussed/reviewed/available. 


4. Conduct additional training for all scorers using recalibration or 
refresher after any sustained break in scoring (e.g., lunch), or at 
the discretion of the trainer (e.g., if reliability is too low overall). 


5. The model sponsor uses only assessors who successfully 
calibrate during the required TPA model assessor training 
sequence. (ADS 2c) 


qe 
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Table 4.B.4 displays checklist performances and findings related to second readings. 


Table 4.B.4. Rater Read-Behind Checklist 


Checklist Item Notes (Include whether observed or documented) 


1. 
Or 
3. 
4. 


10. 


Scoring Leader views reports frequently to monitor reliability. 
Scoring Leader slows or pauses scoring to review reports. 
Monitor pace of scoring (to determine whether on schedule). 


Watch for downward changes. 


Second scoring — Follow-up when reliability is below set standards. 


Second scoring — Backread to check for individual scorer 
problems. 


Second Scoring — Review all responses given a specific score to 
determine if the team as a whole is scoring consistently. 


Second scoring — Review discrepant scores and follow established 
procedures for resolution. 


The scoring process conducted by the model sponsor to assure 
the reliability and validity of candidate outcomes on the 
assessment may include, for example, regular auditing, selective 
back reading, and double scoring of candidate responses near the 
cut score by the qualified, calibrated scorers trained by the model 
sponsor. (ADS 2e) 


The model sponsor provides a detailed plan for establishing and 
maintaining scorer accuracy and inter-rater reliability during field 
testing and operational administration of the assessment. (ADS 
2e) 
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Table 4.B.5 displays checklist performances and findings related to rater monitoring. 


Table 4.B.5. Rater Monitoring Checklist 


Checklist Item 


1. 


Closely monitor any raters who have difficulty applying the 
scoring guide consistently. 


Refer to scoring guide, markers, and practice papers in 
answering questions. 


Inform the group of raters (as needed) to highlight scoring 
distinctions. 


Soon after scoring begins, review each rater’s progress using 
read-behinds and validity papers. 


Provide feedback to raters regarding errors noted during 
read-behinds and validity checks. 


Provide individual training for raters who are having trouble 
(detected in read-behinds, validity papers, second scoring, or 
scoring rate). 

Retrain and re-score performance responses as directed. 
Were any scorers were released from scoring the item due to 
falling below standards following the calibration set? (Provide 
date/time in the notes) 


Back-read an appropriate percentage of performances. 


Notes (Include whether observed or documented) 
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Appendix 4.C: Alignment of ADS and Joint Standards to Claims 


Tables 4.C.1 and 4.C.2 present the full, unedited claim elements that we determined were 
aligned with Claims 3, 4, 7, and 8. Table 4.C-3 presents the full, unedited Joint Standards with 
Comments. 


Table 4.C.1. Assessment Design Standard 1 Design Element Alignment by Claim 


: PN i felat=te| 
Assessment Design Standard 1 Elements Claim(s) 


The Teaching Performance Assessment includes complex pedagogical assessment 
tasks to prompt aspects of candidate performance that measure the TPEs. Each 
task is substantively related to two or more major domains of the TPEs. For use in 
judging candidate-generated responses to each pedagogical task, the assessment _—_ Claim 3, 
1(a) also includes multi-level scoring rubrics that are clearly related to the TPEs thatthe Claim 8 
task measures. Each task and its associated rubrics measure two or more TPEs. 
Collectively, the tasks and rubrics in the assessment address key aspects of the six 
major domains of the TPEs. The sponsor of the performance assessment 
documents the relationships between TPEs, tasks and rubrics. 
The TPA model sponsor must provide materials appropriate for use by programs in 
helping faculty become familiar with the design of the TPA model, the candidate 
tasks and the scoring rubrics so that faculty can effectively assist candidates to Claim 4 
1(g) | prepare for the assessment. The TPA model sponsor must also provide candidate 
materials to assist candidates in understanding the nature of the assessment, the 
specific assessment tasks, the scoring rubrics, submission processes and scoring 
processes. 
The model sponsor develops scoring rubrics and assessor training procedures that 
focus primarily on teaching performance and that minimize the effects of candidate 
factors that are not clearly related to pedagogical competence, which may include Claim 3, 
(depending on the circumstances) factors such as personal attire, appearance, Claim 4 
demeanor, speech patterns and accents or any other bias that are not likely to 
affect job effectiveness and/or student learning. 


1(h) 
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Table 4.C.2. Assessment Design Standard 2 Design Element Alignment by Claim 


: PN ifelat=xe| 
Assessment Design Standard 2 Elements Claim(s) 


2(a) In relation to the key aspects of the major domains of the TPEs, the pedagogical 
assessment tasks, rubrics, and the associated directions to candidates are Claim 3 
designed to yield enough valid evidence for an overall judgment of each candidate’s 
pedagogical qualifications for a Preliminary Teaching Credential as one part of the 
requirements for the credential. 

2(c) | The Teaching Performance Assessment system includes a comprehensive process 
to select and train assessors who score candidate responses to the pedagogical 
assessment tasks. An assessor training program demonstrates convincingly that 
prospective and continuing assessors gain a deep understanding of the TPEs, the 
pedagogical assessment tasks and the multi-level scoring rubrics. The training 
program includes task-based scoring trials in which an assessment trainer Claim 4 
evaluates and certifies each assessor's scoring accuracy and calibration in relation 
to the scoring rubrics associated with the task. The model sponsor establishes 
selection criteria for assessors of candidate responses to the TPA. The selection 
criteria include but are not limited to appropriate pedagogical expertise in the 
content areas assessed within the TPA. The model sponsor selects assessors who 
meet the established selection criteria and uses only assessors who successfully 
calibrate during the required TPA model assessor training sequence. When new 
pedagogical tasks and scoring rubrics are incorporated into the assessment, the 
model sponsor provides additional training to the assessors, as needed. 

2(e) | The model sponsor provides a consistent scoring process for all programs using Claim 4 
that model, including programs using a local scoring option provided by the model 
sponsor. The scoring process conducted by the model sponsor to assure the 
reliability and validity of candidate outcomes on the assessment may include, for 
example, regular auditing, selective back reading, and double scoring of candidate 
responses near the cut score by the qualified, calibrated scorers trained by the 
model sponsor. All approved models must include a local scoring option in which 
the assessors of candidate responses are program faculty and/or other individuals 
identified by the program who meet the model sponsor’s assessor selection criteria. 
These local assessors are trained and calibrated by the model sponsor, and whose 
scoring work is facilitated and their scoring results are facilitated and reviewed by 
the model sponsor. The model sponsor provides a detailed plan for establishing and 
maintaining scorer accuracy and inter-rater reliability during field testing and 
operational administration of the assessment. The model sponsor demonstrates 
that the assessment procedures, taken as a whole, maximize the accurate 
determination of each candidate’s overall pass-fail status on the assessment. The 
model sponsor must provide an annual audit process that documents that local 
scoring outcomes are consistent and reliable within the model for candidates across 
the range of programs using local scoring, and informs the Commission where 
inconsistencies in local scoring outcomes are identified. If inconsistencies are 
identified, the sponsor must provide a plan to the CTC for how it will address and 
resolve the scoring inconsistencies both for the current scoring results and for future 
scoring of the TPA. 

2(g) | The model sponsor conducting scoring for the program provides results on the TPA 
to the individual candidate based on performance relative to TPE domains and/or to 
the specific scoring rubrics within a maximum of three weeks following candidate 
submission of completed TPA responses. The model sponsor provides results to Claim 7 
programs based on both individual and aggregated data relating to candidate 
performance relative to the rubrics and/or domains of the TPEs. The model sponsor 
also follows the timelines established with programs using a local scoring option for 
providing scoring results. 
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Table 4.C.3. Joint Standards Alignment to Claims 
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1.1 The test developer should set forth clearly how test scores are intended to be 
interpreted and consequently used. The population(s) for which a test is intended Claim 7 
should be delimited clearly, and the construct or constructs that the testis intended Claim 8 
to assess should be described clearly. 


Comment: Statements about validity should refer to particular interpretations and 
consequent uses. It is incorrect to use the unqualified phrase “the validity of the 
test.” No test permits interpretations that are valid for all purposes or in all 
situations. Each recommended interpretation for a given use requires validation. 
The test developer should specify in clear language the population for which the 
test is intended, the construct it is intended to measure, the contexts in which test 
scores are to be employed, and the processes by which the test is to be 
administered and scored. 

1.2 A rationale should be presented for each intended interpretation of test scores for a 
given use, together with a summary of the evidence and theory bearing on the Claim 7 
intended interpretation. 


Comment: The rationale should indicate what propositions are necessary to 
investigate the intended interpretation. The summary should combine logical 
analysis with empirical evidence to provide support for the test rationale. Evidence 
may come from studies conducted locally, in the setting where the test is to be 
used; from specific prior studies; or from comprehensive statistical syntheses of 
available studies meeting clearly specified study quality criteria. No type of evidence 
is inherently preferable to others; rather, the quality and relevance of the evidence 
to the intended test score interpretation for a given use determine the value of a 
particular kind of evidence. A presentation of empirical evidence on any point 
should give due weight to all relevant findings in the scientific literature, including 
those inconsistent with the intended interpretation or use. Test developers have the 
responsibility to provide support for their own recommendations, but test users bear 
ultimate responsibility for evaluating the quality of the validity evidence provided and 
its relevance to the local situation. 

2.13 The standard error of measurement, both overall and conditional (if reported), 
should be provided in units of each reported score. Claim 7 


Comment: The standard error of measurement (overall or conditional) that is 
reported should be consistent with the scales that are used in reporting scores. 
Standard errors in scale-score units for the scales used to report scores and/or to 
make decisions are particularly helpful to the typical test user. The data on 
examinee performance should be consistent with the assumptions built into any 
statistical models used to generate scale scores and to estimate the standard errors 
for these scores. 

3.0 All steps in the testing process, including test design, validation, development, 
administration, and scoring procedures, should be designed in such a manner as to | Claim 4 
minimize construct-irrelevant variance and to promote valid score interpretations for 
the intended uses for all examinees in the intended population. 


Comment: The central idea of fairness in testing is to identify and remove construct- 
irrelevant barriers to maximal performance for any examinee. Removing these 
barriers allows for the comparable and valid interpretation of test scores for all 
examinees. Fairness is thus central to the validity and comparability of the 
interpretation of test scores for intended uses. 
(continued) 
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Table 4.C.3. (Continued) 
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3.4 Test takers should receive comparable treatment during the test administration and 
scoring process. Claim 4 


Comment: Those responsible for testing should adhere to standardized test 
administration, scoring, and security protocols so that test scores will reflect the 
construct(s) being assessed and will not be unduly influenced by idiosyncrasies in 
the testing process. Those responsible for test administration should mitigate the 
possibility of personal predispositions that might affect the test administration 

or interpretation of scores. Computerized and other forms of technology-based 
testing add extra concerns for standardization in administration and scoring. 
Examinees must have access to technology so that aspects of the technology itself 
do not influence scores. Examinees working on older, slower equipment may 

be unfairly disadvantaged relative to those working on newer equipment. If 
computers or other devices differ in soeed of processing or movement from one 
screen to the next, in the fidelity of the visuals, or in other important ways, it is 
possible that construct-irrelevant factors may influence test performance. 

Issues related to test security and fidelity of administration can also threaten the 
comparability of treatment of individuals and the validity and fairness of test score 
interpretations. For example, unauthorized distribution of items to some examinees 
but not others, or unproctored test administrations where standardization cannot be 
ensured, could provide an advantage to some test takers over others. In these 
situations, test results should be interpreted with caution. 

3.8 When tests require the scoring of constructed responses, test developers and/or 
users should collect and report evidence of the validity of score interpretations for Claim 4, 
relevant subgroups in the intended population of test takers for the intended uses of | Claim 7 
the test scores. 


Comment: Subgroup differences in examinee responses and/or the expectations 
and perceptions of scorers can introduce construct-irrelevant variance in scores 
from constructed response tests. These, in turn, could seriously affect the 
reliability/precision, validity, and comparability of score interpretations for intended 
uses for some individuals. Different methods of scoring could differentially influence 
the construct representation of scores for individuals from some subgroups. 


For human scoring, scoring procedures should be designed with the intent that the 
scores reflect the examinee’s standing relative to the tested construct(s) and are not 
influenced by the perceptions and personal predispositions of the scorers. It is 
essential that adequate training and calibration of scorers be carried out and 
monitored throughout the scoring process to support the consistency of scorers’ 
ratings for individuals from relevant subgroups. Where sample sizes permit, the 
precision and accuracy of scores for relevant subgroups also should be calculated. 


Automated scoring algorithms may be used to score complex constructed 
responses, such as essays, either as the sole determiner of the score or in 
conjunction with a score provided by a human scorer. Scoring algorithms need to 
be reviewed for potential sources of bias. The precision of scores and validity of 
score interpretations resulting from automated scoring should be evaluated for all 
relevant subgroups of the intended population. 
(continued) 
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4.18 Procedures for scoring and, if relevant, scoring criteria, should be presented by the 
test developer with sufficient detail and clarity to maximize the accuracy of scoring. Claim 3 
Instructions for using rating scales or for deriving scores obtained by coding, scaling, 
or classifying constructed responses should be clear. This is especially critical for 
extended-response items such as performance tasks, portfolios, and essays. 


Comment: In scoring more complex responses, test developers must provide 

detailed rubrics and training in their use. Providing multiple examples of responses 

at each score level for use in training scorers and monitoring scoring consistency is 

also common practice, although these are typically added to scoring specifications 

during item development and tryouts. For monitoring scoring effectiveness, 

consistency criteria for qualifying scorers should be specified, as appropriate, along 

with procedures, such as double-scoring of some or all responses. As appropriate, 

test developers should specify selection criteria for scorers and procedures for 

training, qualifying, and monitoring scorers. If different groups of scorers are used 

with different administrations, procedures for checking the comparability of scores 

generated by the different groups should be specified and implemented. 

The process for selecting, training, qualifying, and monitoring scorers should be 

specified by the test developer. The training materials, such as the scoring rubrics Claim 4, 
and examples of test takers’ responses that illustrate the levels on the rubric score Claim 7 
scale, and the procedures for training scorers should result in a degree of accuracy 

and agreement among scorers that allows the scores to be interpreted as originally 

intended by the test developer. Specifications should describe processes for 

assessing scorer consistency and potential drift over time in raters’ scoring. 


4.20 Comment: To the extent possible, scoring processes and materials should 


anticipate issues that may arise during scoring. Training materials should address 

any common misconceptions about the rubrics used to describe score levels. When 

written text is being scored, it is common to include a set of prescored responses 

for use in training and for judging scoring accuracy. The basis for determining 

scoring consistency (e.g., percentage of exact agreement, percentage within one 

score point, or some other index of agreement) should be indicated. Information on 

scoring consistency is essential to estimating the precision of resulting scores. 

Test developers should specify the procedures used to interpret test scores and, 

when appropriate, the normative or standardization samples or the criterion used. Claim 7 


Comment: Test specifications may indicate that the intended scores should be 
interpreted as indicating an absolute level of the construct being measured or as 
indicating standing on the construct relative to other examinees, or both. In absolute 
score interpretations, the score or average is assumed to reflect directly a level of 
competence or mastery in some defined criterion domain. In relative score 
interpretations the status of an individual (or group) is determined by comparing the 
score (or mean score) with the performance of others in one or more defined 
populations. Tests designed to facilitate one type of interpretation may function less 
effectively for the other type of interpretation. Given appropriate test design and 
adequate supporting data, however, scores arising from norm-referenced testing 
programs may provide reasonable absolute score interpretations, and scores arising 
from criterion referenced programs may provide reasonable relative score 
interpretations. 


4.22 


(continued) 
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5.0 Test scores should be derived in a way that supports the interpretations of test 
scores for the proposed uses of tests. Test developers and users should document Claim 7 
evidence of fairness, reliability, and validity of test scores for their proposed use. 


Comment: Specific standards for various uses and interpretations of test scores and 
score scales are described below. These include standards for norm referenced and 
criterion-referenced interpretations, interpretations of cut scores, interchangeability of 
scores on alternate forms following equating, and score comparability following the 
use of other procedures for score linking. Documentation supporting such 
interpretations provides a basis for external experts and test users to judge the extent 
to which the interpretations are likely to be supported and can lead to valid 
interpretations of scores for all individuals in the intended examinee population. 

6.9 Those responsible for test scoring should establish and document quality control 
processes and criteria. Adequate training should be provided. The quality of scoring 
should be monitored and documented. Any systematic source of scoring errors Claim 4 
should be documented and corrected. 


Comment: Criteria should be established for acceptable scoring quality. Procedures 
should be instituted to calibrate scorers (human or machine) prior to operational 
scoring, and to monitor how consistently scorers are scoring in accordance with those 
established standards during operational scoring. Where scoring is distributed across 
scorers, procedures to monitor raters’ accuracy and reliability may also be useful as a 
quality control procedure. Consistency in applying scoring criteria is often checked by 
independently rescoring randomly selected test responses. Periodic checks of the 
statistical properties (e.g., means, standard deviations, percentage of agreement with 
scores previously determined to be accurate) of scores assigned by individual scorers 
during a scoring session can provide feedback for the scorers, helping them to 
maintain scoring standards. In addition, analyses might monitor possible effects on 
scoring accuracy of variables such as scorer, task, time or day of scoring, scoring 
trainer, scorer pairing, and so on, to inform appropriate corrective or preventative 
actions. When the same items are used in multiple administrations, programs should 
have procedures in place to monitor consistency of scoring across administrations 
(e.g., year-to-year comparability). One way to check for consistency over time is to 
rescore some responses from earlier administrations. Inaccurate or inconsistent 
scoring may call for retraining, rescoring, dismissing some scorers, and/or 
reexamining the scoring rubrics or programs. Systematic scoring errors should be 
corrected, which may involve rescoring responses previously scored, as well as 
correcting the source of the error. Clerical and mechanical errors should be 
examined. Scoring errors should be minimized and, when they are found, steps 
should be taken promptly to minimize their recurrence. 


Typically, those responsible for scoring will document the procedures followed for 
scoring, procedures followed for quality assurance of that scoring, the results of the 
quality assurance, and any unusual circumstances. Depending on the test user, that 
documentation may be provided regularly or upon reasonable request. 
Computerized scoring applications of text, speech, or other constructed responses 
should provide similar documentation of accuracy and reliability, including 
comparisons with human scoring. 


When scoring is done locally and requires scorer judgment, the test user is 
responsible for providing adequate training and instruction to the scorers and for 
examining scorer agreement and accuracy. The expected level of scorer agreement 
and accuracy should be documented, as feasible. 
(continued) 
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6.9 When scoring is done locally and requires scorer judgment, the test user is 
(cont'd) responsible for providing adequate training and instruction to the scorers and for 

examining scorer agreement and accuracy. The expected level of scorer agreement 
and accuracy should be documented, as feasible. 

6.10 | When test score information is released, those responsible for testing programs 
should provide interpretations appropriate to the audience. The interpretations Claim 7, 
should describe in simple language what the test covers, what scores represent, the Claim 8 
precision/reliability of the scores, and how scores are intended to be used. 


Comment: Test users should consult the interpretive material prepared by the test 
developer and should revise or supplement the material as necessary to present 
the local and individual results accurately and clearly to the intended audience, 
which may include clients, legal representatives, media, referral sources, test 
takers, parents, or teachers. Reports and feedback should be designed to support 
valid interpretations and use, and minimize potential negative consequences. Score 
precision might be depicted by error bands or likely score ranges, showing the 
standard error of measurement. Reports should include discussion of any 
administrative variations or behavioral observations in clinical settings that may 
affect results and interpretations. Test users should avoid misinterpretation 

and misuse of test score information. While test users are primarily responsible for 
avoiding misinterpretation and misuse, the interpretive materials prepared by the 
test developer or publisher may address common misuses or misinterpretations. To 
accomplish this, developers of reports and interpretive materials may conduct 
research to help verify that reports and materials can be interpreted as intended 
(e.g., focus groups with representative end-users of the reports). The test developer 
should inform test users of changes in the test over time that may affect test score 
interpretation, such as changes in norms, test content frameworks, or scale score 
meanings. 
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Appendix 4.D: FAST Site Visitation Project Rubric Sample (Field Test compared to Operational) 


Lesson Planning 
: l Field Test | Operational l| Field Test I Operational | Field Test | Operational | Field Test l Operational 
1 4 2 2 | 3 3 4 4 
Sections Does Not Meet Expectations Does Not Meet Expectations. | Meets Expectations Meets Expectations | Meets Expectations at a High Level | Meets Expectations at a High Level Exceeds Expectations Exceeds Expectations 
. | | 
Subject | The lesson plan includes few |The lesson pian includes [The lesson plan includes The lesson plan includes The lesson plan includes [The lesson plan includes | The lesson plan includes, The lesson plan includes content and 
Specific activities or strategies content and related content, activities, or content and related activities content, activities or strategies content and related activities | |content, activities or strategies related activities and strategies 
Pedagogy \consistent with current activities or strategies |Strategies consistent with or strategies: |consistent with current and strategies: | |consistent with current subject- adapted for specific needs of students: 
TPE 3.1, 3.3, | subject-specific pedagogy inconsistent with current |current subject- specific (a) consistent with current |subject-specific pedagogy (a) consistent with current |specific pedagogy and acquisition (a) consistent with current subject-specific 
36 | and/or acquisition of subject- specific pedagogy |Pedagogy or acquisition of | subject-specific pedagogy and and acquisition of academic subject-specific pedagogy and| of academic language. pedagogy and standards, 
academic language and standards, with limited academic language. standards, language. standards, | (b) that provide multiple opportunities 
| support for acquisition or (b) that support the (b) that provide multiple Candidate describes strong for students to acquire and use 
| |Candidate does not use of academic language. Candidate identifies acquisition or use of Candidate describes clear = opportunities for students alignment between activities or © academic language; 
| |identify appropriate activities \appropriate activities or academic language |connections between to acquire and use | strategies within the lesson and (c) with clear evidence of a 
‘or strategies that represent strategies within the lesson activities and strategies within academic language. how they represent subject- plan to monitor students’ 
| |subject- specific pedagogy or |that demonstrate a |the lesson and their | |specific pedagogy and the access to content. 
jacquisition of academic |general understanding of relationship to subject- | acquisition and use of academic 
| language. subject-specific pedagogy specific pedagogy ‘language. 
\or acquisition of academic and acquisition of academic 
| \language. \language. | 
Applying | |Candidate gathers Information about Candidate gathers Information about students, Candidate gathers Information about students, ||Candidate gathers relevant Candidate gathers relevant 
Knowledge of | |limited information on students, gathered by the (acceptable informationon gathered by the candidate, _relevant information on gathered by the candidate, and detailed information on and detailed information on students to be 
Students |students. candidate, provides students. provides useful information (students. provides useful information students. used for planning. 
TPE 3.2, 4.1, little or no useful for planning. for planning. 
42 The lesson plan and information for planning. The lesson plan and The lesson plan and identified The lesson plan and identified Based on knowledge of 
identified activity or strategy identified activity or strategy Based ona general activity or strategy Based on knowledge of |activity or strategy clearly uses individuals or gro’ of 
\demonstrates little or no_ Candidate plans activities | demonstrates a knowledge of students demonstrates a ‘students in this class, ‘specific knowledge of students in the class, candidate plans 
| understanding of the or strategies that demonstrate general understanding of the at this grade level, specific understanding of the candidate plans individuals or groups of appropriate activities or strategies that 
\connection between littie or no understanding of connection between candidate plans appropriate |connection between appropriate activities or \students in the class to promote include accommodations or 
|knawledge of students and —_ the connection between knowledge of students at —_ activities or strategies to knowledge of students in the strategies that include access to content. modifications to promote access to the 
lesson planning. |knowledge of students and _that grade level and promote access to the class and promoting access__accommodations or | content specifically 
promoting access tothe —|promotingaccesstothe —_ content. to the content. \modifications to promote referencing these students. 
content. |content. access to the content. 
Student |The lesson plan and Candidate plans few or |The lesson plan and Candidate's plan for |The lesson plan and identified Candidate's plan for |The lesson plan and identified Candidate's plan for engaging students 
Engagement _ identified activity or strategy inappropriate methods for _ identified activity or strategy +engaging students is activity or strategy includes | engaging students includes | activity or strategy includes many includes varied methods specifically 
TPE 1.1, 1.3, | includes fewornostudent student engagement. includes some student appropriate to the grade \varied student engagement varied methods student engagement techniques connected to the 
15,47 ‘engagement techniques ‘engagement techniques level (e.g. real-life contexts, |techniques appropriate to appropriate to students in | specifically connected to the backgrounds and needs of 


appropriate to the grade level, 
/such as real-life contexts, 
connections to students’ 
jexperiences or interests, 
opportunities for critical or 
\creative thinking, or varied 

| communication strategies 


\appropriate 

\to the grade level, such as 
‘real-life contexts, 

| connections to students’ 
\experiences or interests, 
|opportunities for critical or 
\creative thinking, or varied 


‘communication strategies. 
| 


connections to students’ 
experiences or interests, 
opportunities for critical or 
creative thinking, varied 
communication strategies). 


Note; Field test mentioned that 
the plan includes some student 
engagement techniques 
whereas the Operational rubric 
does not. 


|students in this class, such as this class (e.g, real-life 
\real-life contexts, connections contexts, connections to 


|to students’ experiences or 
interests, opportunities for 


students’ experiences or 
interests, opportunities for 


critical or creative thinking, or critical or creative thinking, 


|varied communication 
|strategies. 
| 


varied communication 
strategies), 


| |backgrounds and needs of individuals or groups of students in the 
| |individuals or groups of class (e.g. real-life contexts, connections to 
| students in the class, such as real- students’ experiences or interests, 
\life contexts, connections to opportunities for critical or creative thinking, 
| students’ experiences or interests, varied communication strategies). 
| opportunities for critical or creative Note: Field test rubric mentions many 
| thinking, or varied communication student engagement techniques 
| strategies whereas the operational rubric does 
not. 
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Appendix 4.E: FAST Teaching Sample Project Rubric Sample (Field Test compared to Operational) 


Students in Context 
Field Test Operational Field Test Operational Field Test Operational Field Test Operational 
1 1 | 2 2 3 3 | 4 4 
Sections Does Not Meet Expectations Does Not Meet Expectations | Meets Expectations Meets Expectations Meets Expectations ata High Level Meets Expectations ata High Level | Exceeds Expectations Exceeds Expectations 
| | 
Implications for Descriptions of Descriptions of |Descriptions of Descriptions of Descriptions of instructional Descriptions of instructional | Description of instructional Description of instructional 
Instruction instructional approaches __ instructional approaches | |instructional \instructional approaches | approaches are specifically approaches are approaches are appropriate. approaches are detailed and 
TPE 1.6, 4.1, 5.8 are inappropriate for: are limited or approaches are are generally appropriate | appropriate for this class for at specifically aligned | detailed, and connected to ‘specifically aligned with the 
inappropriate for at least generally appropriate _for at least two of the least two of the following with the needs of at least | specific students in the class ineeds of all of the following 
(a) different levels of two of the following for this grade level for following groups: groups and: two of the following groups: | for all of the following groups groups: 
English proficiency, groups: |at least two of the and: 
|following groups: (a) different levels of (a) address a range of (a) different levels of English | (a) a full range of English 
(b) students with identified (a) different levels of English proficiency, | levels of English proficiency, proficiency, | (a) address a full range of proficiency levels, 
special needs, English proficiency, |(a) different levels of | |(b) students with (b) students with identified | English proficiency levels, (b) students with identified 
(b) students with [English proficiency, identified special needs, __(b) are aligned with the special needs, special needs, 
(c) students with different identified special needs, (c) students with different | identified special needs of the (c) students with different (b) are clearly matched with the |(c) students with different 
instructional needs. (c) students with different || (b) students with instructional needs. students, instructional needs. | identified special needs of the instructional needs. 
instructional needs. ‘identified special | students, 
needs, (c) reflect the needs of 
students with different | (c) reflect the needs of 
\(c) students with instructional needs. | specific students with different 
different instructional | instructional needs. 
needs. | 
Creating and -Describes no or ‘Expectations for,and —_-Describes Expectations for, and -Describes expectations Expectations for, and -Describes expectations Expectations for, and responses 
Maintaining Effective | |ineffective expectations for responses to, behavior | expectations for responses to, behavior related to individual responses to, behavior focusing on positive classroom to, behavior include specific 
Environments classroom behavior. Or —_ are limited classroom behavior _include responsibility, intolerance, include specific examples behavior and interactions, and examples and 
TPE 2.1, 2.3,26 or inappropriate related related to individual = general examples and an inclusive climate, which related to all of the following: | provides a justification. justification related to (a) 
-Management strategies _ to at least two of the responsibility, related to atleasttwo _/focus on positive classroom individual responsibility, (b) 
are inappropriate forthe following: intolerance, and/or an of the following: behavior and interactions. (a) individual responsibility, -Management strategies intolerance, and (c) an 
grade level. | inclusive climate. |(b) intolerance, reflect fair and respectful inclusive environment, which 
(a) individual (a) individual -Management strategies (c) an inclusive climate, treatment of students, are reflect fair and respectful 
-Identifies no routines or —_ responsibility, -Management responsibility, reflect fair and respectful specifically designed for treatment specifically designed for 
procedures or Describes (b) intolerance, strategies are (b) intolerance, treatment of students and are and focus on positive, students in the class, and the full range of 
an ineffective plan for |(c) an inclusive climate. 2bpropriate for the (c) an inclusive climate. | |appropriate for students in the fair and respectful connect climate to learning. students in the class. 
communicating grade level. class. ‘treatment of students. 
procedures to students. —_ Routines are Routines focus on -Identifies routines or Routines, designed to facilitate 
‘ineffective, with no or | “Identifies routines or management, with a -Identifies routines or Routines are specifically procedures that facilitate learning, are described 
limited description of Procedures and general description of | procedures that facilitate \designed to facilitate learning, | learning, describes a specific and justified, including a 
lhow they were describes a general how they were learning and describes a with a detailed description of | plan for communicating them description of how they were 
communicated to plan for communicated to specific plan for how they were communicated, to students and_ communicated to students 
‘students. communicating them | students. communicating them to ‘to students. families. and maintaining and families, and 
to students. students. them throughout the year. 


maintained throughout the year. 
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Appendix 4.F: FAST Assessor TSP Report of Scores 


Fresno Assessment of Student Teachers (FAST) 
Report of Scores: 


TEACHING SAMPLE PROJECT 


Teacher Candidate: 
ID Number: 


Phase 3 Supervisor: 


1=Does Not Meet Expectations; 2=Meets Expectations; 3=Meets Expectations at a High Level; 
4=Exceeds Expectations. Teacher candidates must receive passing score of 2 or more on each 
section of this project. Teacher Candidates may retake and submit for evaluation any section 
on which they earn a score of “1.” (See FAST Manual for appropriate policies and procedures. ) 


Teaching Sample Project, FAST 2.0 
SECTION SCORE | COMMENTS 


Students in Context 


Learning Outcomes 


Assessment Plan 


Design for Instruction 


Instructional Decision Making 


Analysis of Student Learning 
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Appendix 4.G: FAST SVP Student Score Report from TK20 


SVP - Scoring Rubrics - Final Score: A1 


Assessed By: 
Danella Barnes 


Use this form to enter the students FINAL scores on each of the rubrics. 


SVP - FINAL SCORE 


Site Visitation Project - Final Score: 
Lesson Planning 


(2) Meets Expectations 

Site Visitation Project - Final Score: 
Observation of Lesson 

(2) Meets Expectations 

Site Visitation Project - Final Score: 
Self-Evaluation of Lesson 

(2) Meets Expectations 
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Appendix 4.H: FAST TSP Student Score Report from TK20 


TSP Rubrics 


LEASING CUTCOMES 


Teaching Process Standard: The feacher Sets significant, challenging varied and appropriate learning outcomes 


Learning Outcomes 
and Standards 


TPE37, 33 


TPE 3: Understanding and Organizing Subject Matter for Student Learning 


Standards and 
outcomes do not 
address appropriate 
content knowledge or 
|teracy skills. Outcomes 
poorly represent the 
content and level of 
learning reflected In the 
content standaras, - 
Outcomes reflect a one- 
dimensional lever of 
learning. 


Standards anc 
outcomes primarily 
address either content 
knowledge or literacy 
Skills. Some outcomes 
represent the content 
and level of learning 
reflected In the content 
Standards. -Outcomes 
reflect a limited range in 
the type or level of 
fearning. 


“Standards and 
outcomes cearly 
address both cantent 
knowledge and tIteracy 
skills, -Most outcomes 
represent the content 
and \eve! of learning 
reflected In the content 
standards, -Outcomes 
reflect a range in the 
type or level of learning, 


including 2 focus on 
higher level ‘earning. 


.* 


Appropriateness For 
Students 


TPE 32 


Deseripvon of unit and 
rationale provide limite 
justification for the 
appropriateness of the 
unlt fer students. 


Description of unit and 
rationale provide 
general justification for: 
(a) development of 
either content 
knowledge onprerecy 
skills; (0) past * 
experiences, pre- 
requisite knowledge, or 
future learning, (c) 
relevance for students at 


that grade level 


Description of unit and 
rationale provide 
Specific justification for: 
(a) development of 
content knowledge ana 
literacy skills, (b) past 
experiences, pre- 
requisite knowledge, or 
future learning, (¢) 
relevance for students In 


that class. 


-Standards and 
outcomes clearly reflect 
a connection between 
coritent knowledge and 
literacy skills.-Al! 
outcomes represent the 
content and level of 
laarming reflected in the 
content standards, - 
Outcomes reflect a 
range in the type ar level 
of Jearning, including a 
focus on nigher level 
learning and the 
Integration of content 


and literacy skills, 


Description of unit and 
rationale provide 
Specific justification for: 
(a) integration of content 
knowledge and literacy 
skills, (b) past 
experiences, pre- 
requisite knowledge, 
and future learning, (¢) 
relevance for students In 
that class, specifically 
referencing information 


from Students in 
Context section. 


Learning Outcomes 
Does Not Meet Meets Meets Expectations at a Exceeds 
Expectations Expectations High Level Expectations 
Learning Outcomes - - - Tl] = 
overall rating 
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Appendix 4.I: FAST TSP Student Non-Passing Score Email 


CTATE Jean Behrend <jeanb@mall.fresnostate.edu> 


TSP - not passing 


1 message 


Jean Behrend <jeanb@csufresno.edu> Mon, Apr 16, 2018 at 6:05 PM 
Ta: 
Ce: 


| ragret to inform you that you did not pass the Teaching Sample Project (TSP), You earned a passing 
score on five of the sections, but did not pass the other two sections. 


The two non-passing sections are: Analysis of Student Leaming and Reflection and Self-Evaluation. In 
each of these sections you are missing important elements included in the rubric. In each section you 
have a good start and just need additional information. 


You have the opportunity to redo the sections for a passing score. Please contact me by replying to this 
email to make an appointment to discuss what you will need to do to revise your TSP. I'm available many 
days between 4:00-6:00 pm. Let me know what days or dates would work for you, 


A passing score on the TSP is a requirement to pass EHD 179, 
Dr. Jeanis Behrend 


FAST Coordinator 
jeanb@csufresno.edu 
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Appendix 4.J: edTPA Task 1 (Planning) Rubric Overview 


ed [PA 


edTPA Task 1 Rubrics Construct Measured 


Ri — Planning for Content Learning Candidate’s plans for instruction address content- 
specific skills, concepts, strategies, and/or processes 


R2 - Planning to support varied student Candidate uses knowledge of his/her students to target 
learning needs support for students to develop content-specific skills, 
concepts, strategies, and/or processes 


R3 - Using knowledge of students to Candidate uses knowledge of his/her students to justify 
inform teaching and learning instructional plans 


R4 - Identifying and Supporting Language 
Demands 


Candidate identifies and supports language demands 
associated with content learning tasks 


RS - Planning Assessments to Monitor and | Candidate selects or designs informal and formal 
Support Student Learning assessments to monitor students’ progress toward 
developing content-specific skills, concepts, strategies, 
and/or processes 


SCALE 


Stanford Center for Assessment, Learning, & Equity 
Copy: iT ight « © 2020 Board of Tnustees of the T.cland Stanford Junior University. All rights reserved. The ed TPA trademarks are owned by The Board of Trustees of the Leland Stanford Junior 
sity. 


Use of the ed TPA trademarks is permitted only pursuant to the terms of a written license agreement. Copyright © 2020 Pearson Lducation, Inc. or its affiliate(s). All rights reserved. 
Pearson, ?.O, Box 226, Amherst, MA (1004 
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Appendix 4.K: edTPA Task 2 (Instruction) Rubric Overview 


ed [PA 


edTPA Task 2 Rubrics 


R6 - Learning Environment 


Construct Measured 


Candidate demonstrates a positive learning 
environment that supports students’ engagement in 
learning 


R7 - Engaging Students in Learning 


R8 - Deepening Student Knowledge 


R9 - Subject-Specific Pedagogy 


R10 - Analyzing Teaching Effectiveness 


Candidate actively engages students in developing 
content-specific skills, concepts, strategies, and/or 
processes 


Candidate elicits student responses to promote thinking 
and to develop content-specific skills, concepts, 
strategies, and/or processes 


Candidate uses subject specific pedagogical strategies 
and/or materials to support students’ understanding of 
content-specific skills, concepts, strategies and/or 
processes 


Candidate uses the analysis of what students know and 
are able to do to plan next steps in instruction 


SCALE 


Stanford Center for Assessment, Learning, & Equity 


Copyright © 2020 Thoard of Trustees of the T.cland Stanford Junior University. All rights reserved. The edTPA trademarks are owned by The Board of Trustees of the T-cland Stanford Junior 


University. 


Use of the ed TPA trademarks is permitted only pursuant to the terms of a written license agreement. Copyright © 2020 Pearson Lducation, Inc. or its affiliate(s). All rights reserved. 


Pearson, ?.O, Box 226, Amherst, MA (1004 
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Appendix 4.L: ed TPA Task 3 (Assessment) Rubric Overview 


ed [PA 


edTPA Task 3 Rubrics Construct Measured 

R11 - Analysis of Student Learning Candidate analyzes evidence of student learning of 
content specific skills, concepts, strategies, and/or 
processes 


R12 - Providing Feedback to Guide Candidate provides feedback to focus students that 
Learning addresses their strengths and needs 


R13 - Student Use of Feedback Candidate provides opportunities for students to use 


feedback to guide their further learning 


Candidate analyzes students’ use of language to develop 
content understanding 


R14 - Analyzing Students’ Language Use 
and Content Learning 


R15 - Using Assessment to Inform Candidate uses the analysis of what students know and 
Instruction are able to do to plan next steps in instruction 


SCALE 


Stanford Center for Assessment, Learning, & Equity 
Copyright © 2020 Board of Tiustees of the Leland Stanford Junior Thiversity, All rights reserved. The edTPA trademarks are owned by The Board of Trustees of the Leland Stanford Junior 
University. 
Use of the ed TPA trademarks is permitted only pursuant to the terms of a written license agreement. Copyright © 2020 Pearson Lducation, Inc. or its affiliate(s). All rights reserved. 
Pearson, ?.O, Box 226, Amherst, MA (1004 
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Appendix 4.M: edTPA Institution Report Layout 


ed PA. 


edTPA® Institution Report Layout 
The edTPA Institution Report will be produced as an ASCII-formatted, pipe-delimited (“|”) 
data file. The data file will not include a header record. The file contains the data elements 
in the order shown below. 


The extract files will contain data only for Candidates who submitted an edTPA assessment 
to Pearson for scoring (no withdrawals or void data will be reported). 


File naming convention: rT PAXXXXXXXX-ZZeY YY YMMDD.asc 


R stands for “report” 

TPA acronym for edTPA 

XXXXXXXX -_- 6 or 8 institution code 

- dash 

ZZ 2-character state code 

E examinee (candidate) file identifier 


YYYYMMDD _ extract posting date (year/month/day) 


Max 
Length 


tame | a0 ena tr ane 
Middle initial Candidate middle initial 


Data Element Description 


Last 5 digits of Candidate Social Security Number only 
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Max ee 
Data Element Length Description 


Candidate score on total score point scale (sum of all rubric scores, 
excluding Washington Student Voice Rubrics) 


In the case of a .5 score at the Total edTPA Score level (e.g., 39.5), 
the Total edTPA score will be rounded up to the next highest whole 

number. For example, a Total edTPA Score of 39.5 will be reported 

as a 40. Only the Total edTPA Score will be rounded (Rubric Scores 

and Task Totals are not rounded). 


edTPA Total Score 


Effective 10/22/2015: If a candidate receives two or more 
condition codes within the same task, the task total score, average 
total rubric score, and total portfolio score will be reported as “I” for 
“incomplete.” 


Average rubric score obtained for all scored rubrics (excluding 
Washington Student Voice Rubrics) 


Average Total 
Rubric Score 


Is Prep Inst Code 


Effective 10/22/2015: If a candidate receives two or more 
condition codes within the same task, the task total score, average 
total rubric score, and total portfolio score will be reported as “I” for 
“incomplete.” 


A value of "1" indicates the candidate has identified this institution 
as his/her educator preparation institution during edTPA 
registration. 


This field is used only at campuses that are using an edTPA Platform 
Provider System integrated with the Pearson system. If the Platform 
Provider sends a Partner Candidate ID with a transferred portfolio, 
the Pearson system will return it with the appropriate scores. 


Platform Provider 
ID 


Candidate score on total score point scale (sum of all rubric scores, 
including Washington Student Voice Rubrics). This field will be 
blank for candidates who have taken a National Handbook. 


This value will include the rounded Total edTPA Score (if applicable). 


edTPA Total Score The Total Score with Student Voice is not also rounded. 


with Student Voice 


Effective 10/22/2015: If a candidate receives two or more 
condition codes within the same task, the task total score, average 
total rubric score, and total portfolio score will be reported as “I” for 
“incomplete.” 


Average rubric score obtained for all scored rubrics (including 
Washington Student Voice Rubrics). This field will be blank for 


Average Total candidates who have taken a National Handbook. 


Rubric Score with 


Student Voice Effective 10/22/2015: If a candidate receives two or more 


condition codes within the same task, the task total score, average 
total rubric score, and total portfolio score will be reported as “I” for 
“incomplete.” 


Fanitiieier Sania ae ee s unique identifier for the Candidate during this reporting 
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Max 
Length 


Data Element Description 

Test status based on state-approved passing standard (P=Pass, 

State Pass Fail F=Fail, T=Taken). States that approved a state passing standard for 

Status Code assessments will have P or F. States that do not have an approved 
passing standard for assessments will have a T for Taken. 


Field Specialty Specialty Area selected by candidate in edTPA Registration process. 


Unique state identification code assigned by the state licensing 
State Identifier agency and supplied by the candidate during edTPA registration, 
when applicable. 


edTPA Score to Rubric Mapping 
Notes about the Score mapping to Handbook Rubric Descriptions: 
* The World Language (WL) and Classical Languages (CL) Handbooks (both National 
and Washington) will contain null values for the Academic Language Rubrics. 
* The Washington Handbooks contain Student-Voice rubrics which will have null values 
for all National assessments. 
* The Elementary Education Handbook contains Mathematics Assessment Rubrics 
which will have null values for all other assessments. 


See below for detailed field mapping to Handbook Rubrics. 


Rubric Numbers 


National Handbooks Washington Handbooks Rubric Description 


World World 
Language and Language and 
Classical Classical 
Languages Languages 


Planning: Planning for Subject- 
sees [ot ft ft | ecetieranangs 
Planning: Planning to Support Varied 


Analyzing Teaching: Using Knowledge 
of Students to Inform Teaching and 
Learning 

Academic Language: Identifying and 
Supporting Language Demands 
Planning: Planning Assessments to 
Monitor and Support Student Learning 


ie a fest Fae Instruction: Learning Environment 


Instruction: Engaging Students in 
re re 

Instruction: Deepening Student 
re 
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Rubric Numbers 


Score | National Handbooks Washington Handbooks Rubric Description 


World World 
Language and Language and 
Classical Other Classical 
Languages Languages 


Instruction: Subject-Specific 
Pedagogy: Using Representations 
Analyzing Teaching: Analyzing 
Learning 
Assessment: Providing Feedback to 
Assessment: Student Understanding 
Academic Language: Analyzing 

Score 14 Students’ Language Use and Subject- 
Specific Learning 


Analyzing Teaching: Using 


Student Voice: Eliciting Student 
Understanding of Learning Targets 


Student Voice: Supporting Student 
Use of Resources to Learn and Monitor 
Their Own Progress 


Student Voice: Reflecting on Student- 
Voice Evidence to Improve Instruction 
Rubric 16: Mathematics Assessment: 
Analyzing Whole Class Understandings 

Elem. Ed Rubric 17: Mathematics Assessment: 

par Analyzing Individual Student Work 
Y Samples 

Rubric 18: Mathematics Assessment: 
Using Evidence to Reflect on Teaching 


Other 
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Field Code 


edTPA Content Area 


| OOk. | Elementary Literacy (National) 
, cgay = 1 Elementary Mathematics (National) 
| 003 Secondary English-Language Arts (National) 


007 
008 


Oil 
012 


016 
017 


019 


[023 |eementary uteracy (Washington) 
[024 [Piysical Education (Washington) 
[025 [Special Education (Washington) 
028 [visual arts (Washington) 
[030 ]k-12 Performing Ars (Washington) 


102 


Business Education (National) 


Educational Technology Specialist (Washington) 
Effective June 27, 2016: This handbook is no longer available. 
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edTPA 
Field Code 


edTPA Content Area 


Elementary Education (National) 
English as an Additional Language (National) 
English as an Additional Language (Washington) 


: 
i 
; 


Technology and Engineering Education (Washington) 
Literacy Specialist (National) 


Rubric Score Values and Condition Codes 


Rubric Scores are detailed in the edTPA Handbooks and the values are 1, 2, 3, 4, or 5. Ifa 
scorer is unable to assign a score, a condition code is assigned. The following table explains 
the condition codes. Complete descriptions of these codes are available at www.edTPA.com. 


Condition Code Description 


Video is edited 


Materials unrelated to Handbook or fail to conform to Handbook 
instructions 


English translation requirement not met 


“Incomplete” Status. Effective October 22, 2015: Portfolios receiving two or more 
condition codes within the same task will be considered “incomplete.” The following scoring 
rules will be applied if candidates receive two or more condition codes within the same task: 


ar Incorrect or missing, blank, or otherwise inaccessible file 


e All scored rubrics with the rubric score value and any condition code indicators will 
continue to be reported. 


e Task Total will be reported as “I” for “incomplete.” 
e Total edTPA score will be reported as “I” for “incomplete.” 
e Average rubric score will be reported as “I” for “incomplete.” 


Candidates will be required to retake any task(s) reported as incomplete (receiving two or 
more condition codes within the same task) in order to receive a Task Total, Total edTPA 
score, and Average Rubric Score. 
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Appendix 4.N: edTPA Score Profile Interpretation Document 


Interpreting Your edTPA Score Profile 


Your edTPA Score Profile provides your 


results and a description of your performance 


for the assessment that you submitted. 


Score Summary 


The most recent scores you have eared on this 


assessment across all attempts 


2 Rubric Score 
This column displays your score for each 
edTPA rubric. These scores may be 
reported as average, as more than one 
scorer may score your portfolio. 


€ is a letter (e.g., “A”) (Ble) ) 
iss ould not be red due 


‘o one of the conditions listed in the “Condition 
Codes” in the Submission Requirements 
document on the Candidate Policies page at 


www.edTPA.com 


Total ed TPA Score 

The total is the sum of all rubric scores. In 
the case of a .5 score at the Total edTPA 
Score level (e.g., 39.5), the Total edTPA 
score will be rounded up to the next highest 
whole number (e.g., 40) 

Note: Rubrics without a numeric score are 
included in the To ITPA Score, and Po 
receiving two or more conditi 

same task will be c 


Average Rubric Score 
The average score is calculated by 
dividing the Total edTPA Score (unrounded) 


etd 
Note 


Score Profile 


Secondary Mathematics 
Submitted: Month DD, 20VY 
Reported: Month DD, 20YY 


Name: Firstname Lastname 
Social Security Numner 4-1234 
For pnvacyiconftentiaity reasons, only te tast five cigts Of your social setunty number are coMected 


Score Summary 


z “ is 

Task 1: Planning 

| Rubric 1: Panning for Mathemabcal Understandings 

\ Rubric 2° Planning to Support Varied Student Leaming Needs 
Rubric 3. Using Knowledge of Students fo Inform Teaching and Learning 
Rubric 4) id ying and Se q quag 
Rune 5 Planneng Assessments to Monitor and Support Student Leareng 


Rubric 14: Anatyzing Students’ Language Use and Mathematics Learning 
Rubric, 15: Using Assessment to Infor instruction 


Tash Total 19.0 out of 25 


3 
__ Total edTPA ScoreQ™ 62 out of 75g 
[Average Rute Score (3.43 


Note: Your edTPA Score Profile indicates your Total ed TPA Score Please refer to www.edTPA.com/Scores for information 
abut avy Efate oF institution epeeiic paswng score requiremente. 


OE 51) Om A |i OL Toe LON EE AO PS ENS HHO 
4 PATON ememeres oe carert in) The Dat if Trimm 9 bere Remet heey someneety 
7 Fe i ee ee hee ee ee a 


‘Thie aarceme cpetatee ari cendisate inforeer toe 


qe 


Oaduuny 
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PoMEME OTe) ateli (lols m Olere(-1-) 
The following table identifies the possible condi- 
tion codes. Complete descriptions of these codes 
are available in the Submission Requirements 
document on the Candidate Policies page at 
www.edTPA.com. Note that Condition Code 
descriptions were updated for the 2015-2016 
program year 
Condition Code Reason 
Rubrics for Planning Task are unscorable 
Video technical issues 
Audio technical issues 
Insufficient or excessive information to score 
Incorrect or missing, blank, or otherwise 
inaccessible file 
Video is edited 
Materials unrelated to Handbook or fail to 
conform to Handbook instruction 
English translation requirement not met 


“Incomplete” Status 

Effective October 22, 2015. Portfolios receiving 
two or more condition codes within the same 
task will be considered “Incomplete.” The follow- 
ing scoring rules will be applied if you receive two 
or more condition codes within the same task: 


* All scored rubrics with the rubric score value 
and any condition code indicators will contin- 
ue to be reported 
Task Total will be reported as “incomplete 
Total ed TPA Score will be reported as “incom- 
plete 
Average Rubric Score will be reported as 
alee lente) (ite 
u will be required to retake any task(s) reported as 

incomplete (receiving two or more condition codes 


within the same task) in order to r ive a Task Total 
Total ed TPA Score, and Average Rubric Score 


Score Profile 


Secondary Mathematics 
Submitted: Month OD, 20YY 
Reported: Month OD, 20YY 


1) Snead! AREY NUEIOE are 


Score Summary 


Rubric What to Submit | Paes . = 


Task 1: Planning 


Ruprc | Planrang for Mathennmca: Unoersandings 
Rubric 2 Prannang t0 Support Varied Student Learning Needs 

Rubric 3: Using Knowledge of Students to inform Teacteng and Learting 
Rubric 4: identityeng and Supporting Language Demands 


ube 5 Pang Assessments fo Moniot anc Suppor Stugent Leaning 


Task 2: instruction 


Rubric Leaenig Crwin nment 
Rubric 7: Cogeqing Students Learning 
Rubric & Deepening Student Learning 
Rubric 9 Subjoct-Speciie Pedagogy’ Using Representations 
Ruibrc 10 Analyzing Teaching Effectiverarss 
Task Total 


Task 3. Assessment 


Foutwits ) t Ansaryes cif Stimtert! ( esaereeny 


Ruleic (2. Providing Feedback to Guide Leer 


Rubric 13. Sliven Use of Feedian 


Rubric 14° Anatyzir ms’ Language Use and Mathematics Learning 


Rubric 15 Using Assessinent to inform Instruction 


Total edTPA 


Average Rubric Score 


Note Your edTPA § 


DOA arty State oF 


c pasany score requaremants 


micates your Total ed TPA Score Please refer lo www.edTPA.com/’Scores for mination 


16.6 out of 26 


saolpueddy -/] auinjon — SJEpOW Vd _L {0 Apiqesedwioy jo uojebiysenu] 


LS-N'V 


ed PA Score Profile 


ed [PA —— 


7 Performance Description Submitted: Month DD, 20VY 
This section describes your performance on each Reported: Month DD, 20YY 
scoring rubric. Use this information to interpret 
your performance 


Name Firstname Lastname 


Social Security Number. 5-1234 


Fat prvacyeneminentairy macnn, onty the ast five Cagis nf your Socal SenuMty sumbher are enapeman 


m= Merelslelliielamerele(—Mat-t-e.-\-1al-|0)9)| eB on- Bees lale) 
rubric(s), the description provides information 


Performance Description 
indicating the requirement(s) not met 


Planning: 
: Rubric | Performance Description 
Score Reporting [> «| Piatt ha Sutinten lilt on ech vier teppeet bereg ner er ene 
These states and/or institutions also | | Doncepts ANLY mathemaucal reasoning ardor f : 
received your results, as you requested during 2 _| inaviduas or groups wih sirdar beegs AND canadale abends io equremserts IEPs and S04 plans 
reel iig-lifelg) | | Canad Be |LESTes why learneng tasks (or their adaptations) are anpropnate using examp { students’ prior 


research ary 


10 eens of personaticiiiueal crevenunity assets Canelicate makes oonmections lo 


aircbacheaee bch a AND ada 


fles vocabutary ando Ong teNgUIge Gernands) acsocksled wih the 


4 language function Plans mcude gene pport for use of vocabulary a 6 a6 wel os ackditonal 
language demands) 
Thesstssssents provide cydence lo enoniior sludenty conveplaal undersiencieg procedural Nuency. AND 


Mmathyvernatic 


SSN and/or PrObMen GOAVINg SAS Gurey the warning segment Agcesement amaptations 


required by IEP or 50 ans. we made 


Additional Information 


Retaking the edTPA 


There are multiple options for retaking an edTPA 

: fy time ps Sitaterds ames enegetcerd eet kere rainy tettoks Unetl elites uncte stanetilngs OF creat emetic Comeepts 
assessment ? procedures. AND matnemanicai reasoning anvor problem solving skills. Canditase links prior acagenic leanung 
to new igarmung 
Caneidat 


proced 


Instruction 
Rubric | Performance Description 


The canditate demonsiates r et with and respect for students, Candidale provides @ Positive. how-rtsk socal 
erivecement thal reveals mutual respect among students 


. retake a single or multiple tasks, or 


standryy Of matherr 


Saupe he 


peel taits 


Ss cnderslaned trualtrermatica 


retake the entire assessment 


annie 
and proceaures 


Caniiate proposes Charges inal adaress stuoents codectve learreng needs related fo (he Ceriral focus 
Incdate makes Sup connections (0 res@arc andlor theory 


Consult with your program faculty about retaking 
edTPA and refer to www.edTPA.com/Scores for 
registration and submission instructions 


Score Reporting 


Your scores have been released to the following state(s) and/or institution(s) 


Insttuborys 


or University 


Appendix 4.0: CalTPA Cycle 1 Rubrics for Multiple Subject 


CalTPA Performance Assessment Guide 


Instructional Cycle 1 
Multiple Subject 


Learning About Students and Planning Instruction 


Step 1 Rubrics 
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Rubric 1.1 — Step 1: Plan 


Essential Question: How does the candidate’s proposed learning goal(s) connect with prior knowledge and define specific outcomes for 


students? How do proposed learning activities and instructional strategies support, engage, and challenge all students to meet the learning 
goal(s)? 


Level 1 


Candidate’s lesson plan 
Includes goal(s) that are not 
based on students’ prior 
content knowledge. 


OR 


Candidate does not identify 
evidence of student learning 
they will look for, and 
assessment strategy is not 
purposefully connected to 
content-specific learning 
goal(s). 


Planned learning activities 
are not well structured to 
meet the learning goal(s), or 
instructional strategies do 
not respond to the diverse 
needs of learners. 


Level 2 


Candidate’s lesson plan 
includes goal(s) that are 
loosely built on students’ 
Prior content knowledge, 
and scaffolding is not likely 
to support student learning. 


Candidate identifies 
evidence of learning that 
focuses on rote knowledge 
of content or is only partially 
connected to content- 
specific learning goal(s). 


Plan for student grouping is 
not conducive to the type of 
lesson being planned, and 
rationale for approach is not 
clear. 


Level 3 


Candidate's lesson plan 
includes manageable and 
appropriate goal(s) that 
clearly build on students’ 
prior content knowledge. 


Candidate clearly identifies 
the kinds of evidence they 
will look for to determine 
that students met the 
learning goal and the 
assessment(s) they will use 


to make this determination. 
Lesson plan includes learning 


activities that are 
appropriately engaging, 
challenging, and/or 


accessible for students, and 


grouping strategies are 
appropriate. 


Copyright © 2018 by the California Commission on Teacher Credentialing 


1900 Capitol Avenue, Sacremento, CA 95811. All rights reserved. 


Level 4 


All of Level 3, plus: 


Candidate’s lesson plan 
provides a detailed 
explanation of proposed 
instructional adaptations 
and accommodations to 
support focus students and 
other individuals during the 
lesson. 


Level 5 


All of Levels 3 & 4, plus: 


Candidate’s lesson plan is 
based on UDL principles and 
is sufficiently flexible to 
provide for an inclusive 
learning environment 
reflective of students’ assets 
and needs where all 
students clearly have equal 
access to content by 
engaging in challenging 
learning activities that 
develop academic language 
and higher-order thinking. 
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CalTPA Performance Assessment Guide Instructional Cycle 1 
Multiple Subject Learning About Students and Planning Instruction 


include modeling and 
scaffolding that will assist 
students to reach 
expectations embedded in 
the learning activities, 
including higher-order 
thinking and academic 
language development. 


TPEs and Elements: TPE 1, Elements 1, 4; TPE 2, Element 2; TPE 3, Elements 1, 2, 3, 5; TPE 4, Elements 1, 4, 7; TPE 6, Element 5 
Primary Sources of Evidence: 

* Written Narrative: Getting to Know Your Students (Description of Students’ Assets and Needs [whole class}) 

* Lesson Plan 

¢ Written Narrative: Lesson Plan Rationale 

© Related Instructional Resources and Materials 
Content-Specific Pedagogy 
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CalTPA Performance Assessment Guide 


Multiple Subject 


Instructional! Cycle 1 


Learning About Students and Planning Instruction 


Rubric 1.2 — Step 1: Plan (Focus Student 1—English Learner) 


Essential Question: How does the candidate plan instruction using knowledge of FS1’s (English learner) assets and needs* to support 
meaningful engagement with the content-specific lesson goal(s)? 


Level 1 


Candidate's plan does not 
take into account the 
reading, writing, listening, or 
speaking requirements of 
the content taught in the 
lesson, 


Candidate primarily displays 
deficit thinking In relation to 
FS1. 


Candidate does not connect 
knowledge of FS1’s assets 
and needs to the lesson, 


NT) 


Planned adaptations and/or 
accommodations minimally 
connect FS1's assets or 
learning needs to the 
expected reading, writing, 
listening, or speaking 
abilities required of the 


content taught in the lesson. 


Level 3 


Planned supports for student 
learning are clearly built on 
FS1's assets and learning 
needs, 


Candidate’s plan provides 
appropriate adaptations and 
accommodations, as 
needed, to support FS1 to 
access core content of the 
lesson through required 
reading, writing, listening, or 
speaking, 


Candidate provides a cogent 
rationale in plan for how 
language adaptations and 
accommodations used 
during the lesson encourage 
FS1's progress toward 
meeting learning goal(s). 


Level 4 


All of Level 3, plus: 
Candidate plans 
Opportunities for FS1 to 
participate in different 
modes of communication 
(e.g., collaborative, 
interpretive, and/or 
productive language) during 
the lesson to access content 
needed to meet learning 
goal(s). 


TPEs and Elements: TPE 1, Elements 1, 6; TPE 3, Elements 1, 2, 5; TPE 4, Elements 1, 4, 7; TPE5, Element 2 
Primary Sources of Evidence: 
* Written Narrative: Getting to Know Your Students (Description of Focus Student 1’s Assets and Needs) 
® Lesson Plan 
* Written Narrative: Lesson Plan Rationale 
* Related Instructional Resources and Materials 


Level 5 


All of Levels 3 & 4, plus: 


Candidate plans a lesson 
using UDL strategies that 
purposefully create an 
inclusive environment to 
support FS1’s content- 
specific learning through 
reading, writing, listening, 
and/or speaking as part of 
the whole class community. 
Candidate's rationale cites 
evidence-based English 
language development 
practice(s), 


* For example: prior academic knowledge; social-emotional development; social identity; cultural and linguistic resources and funds of knowledge; prior 
experiences and interests; developmental considerations; proficiency in reading, writing, speaking, and listening 
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CalTPA Performance Assessment Guide 


Multiple Subject 


Instructional Cycle 1 


Learning About Students and Planning Instruction 


Rubric 1.3 — Step 1: Plan (Focus Student 2—Student with identified special needs) 


Essential Question: How does the candidate plan instruction using knowledge of FS2’s (student with identified special needs) assets and 
needs* to support meaningful engagement with the content-specific lesson goal(s)? 


Level 1 


Candidate does not connect 
knowledge of FS2’s assets, 
needs, or IEP/S04/GATE 
goals to lesson plan. 


OR 


Candidate primarily displays 
deficit thinking in relation to 
FS2. 


Planning for gifted students 
only includes additional, 
similar work and does not 
expand or extend their 
developmental or academic 
learning. 


TPEs and Elements: TPE 1, Elements 1, 4; TPE 3, Elements 1, 2, 5; TPE 4, Elements 1, 2, 4, 5; TPE 5, Elements 2, 8 


Level 2 


Planned accommodations 
minimally attend to 
1EP/S04/GATE goals or do 
not identify needs between 
FS2’s current developmental 
or academic abilities and the 
learning demands of the 
lesson. 


Candidate’s plan includes 
limited or inappropriate 
scaffolding, support(s), or 
accommodations to address 
learning needs of FS2 during 
the lesson. 


Candidate reduces the rigor 
of learning activities and 
instructional strategies in 
ways that limit student 
access to content-specific 
learning goal(s). 


Primary Sources of Evidence: 
« Written Narrative: Getting to Know Your Students (Description of Focus Student 2’s Assets and Needs) 


e Lesson Plan 


e Written Narrative: Lesson Plan Rationale 
e Related Instructional Resources and Materials 


* For example: prior academic knowledge; social-emotional development; social identity; cultural and finguistic resources and funds of knowledge; prior experiences 
and interests; developmental considerations; assistive technologies; learning challenge (identified |EP goals; focus of 504 plan or MTSS support; or need for greater 


challenge through GATE) 


Level 3 


Planned accommodations 
attend to IEP/504/GATE 
goals and identified assets 
and needs between FS2’s 
current developmental or 
academic abilities and the 
demands of the lesson, 
allowing FS2 to fully access 
content and meet learning 
goals. 


Candidate provides a cogent 
rationale in plan for 
scaffolding activities and 
strategies to accommodate 
FS2's progress toward 
meeting learning goal(s). 


Copyright © 2018 by the California Commission on Teacher Credentialing 
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Level 4 


All of Level 3, plus: 
Candidate’s lesson plan 
builds on and highlights 
FS2’s assets and learning 
needs. 


Level 5 


All of Level 4, plus: 


Candidate plans a lesson 
using UDL that purposefully 
creates an inclusive 
environment to support 
FS2’s content-specific 
learning as part of the whole 
class community. 


Candidate’s rationale cites 
evidence-based practice(s) 
appropriate to the IEP, 504 
plan, or other pre- 
determined learning goals 
for FS2. 
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CalTPA Performance Assessment Guide 


Multiple Subject 


Instructional Cycle 1 


Learning About Students and Planning Instruction 


Rubric 1.4 — Step 1: Plan (Focus Student 3—Student with academic/emotional support 
needs due to life experiences inside or outside of school) 


Essential Question: How does the candidate plan instruction using knowledge of FS3’s* assets and needs** to support meaningful 


engagement with the content-specific lesson goal(s) and address the student's well-being by creating a safe and positive learning environment 
during or outside of the lesson***? 


Level 1 


Candidate’s support during 
or outside of the lesson 
provides limited support for 
FS3 to address needs for a 
safe, positive, and inclusive 
environment. 


Candidate primarily displays 
deficit thinking in relation to 


FS3. 
OR 


Activities or strategies are 
reduced in rigor or are 
inappropriate in ways that 
could expose student 
vulnerability or undermine a 
safe learning environment. 


Candidate demonstrates 
inaccurate understanding of 
FS3’s needs and how to 
ensure a safe and positive 
environment for learning. 


Level 2 


Planned activities and/or 
strategies and assessment 
during or outside of the 
lesson may be responsive to 
the life experience(s) of FS3, 
but it is not clear that the 
supports contribute to 
establishing a safe and 
positive environment and 
promote FS3’s well-being. 


Candidate minimally 
connects knowledge of FS3’s 
assets and needs to 
selection of activities, 
strategies, and informal 
assessment OR provides a 
superficial understanding of 
student needs and how to 
create a safe and positive 
environment for learning 
during or outside of the 
lesson. 


Level 3 


Planned activities, strategies, 
and assessment during or 
outside of the lesson are 
designed to provide a safe 
and positive learning 
environment, promote FS3’s 
well-being, and support 
FS3’s progress toward 
meeting the content-specific 
learning goal(s). 
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Level 4 


All of Level 3, plus: 


Candidate articulates how 
plans build on FS3’s assets 
and learning needs and 
explains why the lesson is 
likely to be responsive to 
FS3’s life experience(s). 


Level 5 


All of Level 4, plus: 
Candidate plans a lesson 
using UDL that purposefully 
creates an inclusive 
environment to support 
FS3’s content-specific 
learning as part of the whole 
class community. 


Candidate’s rationale cites 
appropriate evidence-based 
practice(s) to support the 
needs of FS3. 
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CalTPA Performance Assessment Guide Instructional Cycie 1 
Multiple Subject Learning About Students and Planning Instruction 


TPEs and Elements: TPE 1, Elements 1, 4; TPE 2, Elements 1, 2, 3, 4; TPE 3, Elements 1, 2, 5; TPE 4, Elements 1, 2, 4; TPE 5, Elements 2, 8 


Primary Sources of Evidence: 
* Written Narrative: Getting to Know Your Students (Description of Focus Student 3’s Assets and Needs) 

Lesson Plan 

« Written Narrative: Lesson Plan Rationale 

Related Instructional Resources and Materials 


* FS3 is a student whose life experience(s) either inside or outside of school (including, but not limited to, challenges in the home, community, or school as a result of 
bullying, illness, loss of parents, divorce, trauma, homelessness, poverty, or incarceration, of as a result of needs as a Standard English learner; a migrant, an immigrant, 
or an undocumented student; or a student in foster care) may result in a need for additional academic and/or emotional support and whose behavior in class catches 
your attention (e.g., does not participate, falls asleep in class, remains silent, acts out, demands attention). 

** For example: prior academic knowledge, social-emotional development, social identity, cultural and linguistic resources and funds of knowledge, prior experiences 
and interests, and developmental considerations 


*** Describe any additional supports that you provide to FS3 that occur outside of the lesson being taught in Cycle 1, 
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Step 2 Rubrics 
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Rubric 1.5 — Step 2: Teach and Assess 


Essential Question: How does the candidate establish clear learning expectations based on an understanding of students’ prior knowledge 
and maintain a positive learning environment* that supports all students to access and meet the content-specific learning goal(s)? 


Level 1 


Candidate does not set clear 
learning expectations during 
the opening of the lesson. 


OR 


Candidate does not connect 
lesson to prior learning or 
explain how it fits in the 
larger unit of instruction. 


Candidate’s annotations do 
not explain why or how a 
positive and safe learning 
environment is established. 


Level 2 


Candidate sets vague 
learning expectations during 
the opening of the lesson 
and minimally connects 
lesson to prior learning. 


Candidate’s annotations 
minimally explain 
strategy(ies) attempted to 
establish a positive and safe 
learning environment. 


It is not clear that strategies 
will support students to 
access and meet content- 
specific learning goal(s). 


Level 3 


Candidate sets learning 
expectations during the 
opening of the lesson, 
directly connects the lesson 
to prior learning of content, 
and explains how this lesson 
fits in the larger unit of 
instruction, 


Candidate's annotations 
explain how a positive and 
safe learning environment 
was established. 


Strategies seen in video(s) 
support students to access 
and meet content-specific 
learning goal(s). 


TPEs and Elements: TPE 2, Elements 2, 3, 5, 6; TPE 4, Element 4 
Primary Source of Evidence: 
® 3 Annotated Video Clips 


Level 4 


All of Level 3, plus: 
Candidate and students 
interact with each other 
through questioning and 
conversation that 
demonstrates positive and 
respectful rapport with each 
other and reinforces deep 
learning of content. 


Level 5S 


All of Levels 3 & 4, plus: 
Candidate’s annotations 
explain how and why the 
UDL strategy(ies) used 
establish an inclusive 
environment that supports 
all students to learn and how 
these strategies provide 
equitable access to content. 


* For example: setting clear expectations, framing the lesson, creating a safe and welcoming environment, greeting students, establishing central question(s) and/or 
lesson hook, engaging students, establishing positive rapport 
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CalTPA Performance Assessment Guide Instructional Cycle 1 
Multiple Subject Learning About Students and Planning Instruction 


Rubric 1.6 — Step 2: Teach and Assess 


Essential Question: How does the candidate actively engage students in deep learning of content and monitor/assess their understanding? 
Level 1 od Level 3 Level 5 
Instruction and assessment Instruction and assessment Instruction and assessment All of Level 3, plus: All of Levels 3 & 4, plus: 
demonstrate lack of require students toengage | require students to actively | students have opportunities | Instruction and assessment 
| attention to the levels of in lower-order thinking engage In higher-order to actively develop their own | promote inclusion for all 
_ student engagement with about content, AND/OR thinking/deep learning understandings linked to students through providing 
content and/or classroom strategies engage students | (analysis, synthesis, lesson goal(s). opportunities to participate 
management necessary for | in passive learning of evaluation, interpretation, E in classroom discourse and 
student learning. content during the lesson transfer) about content. pa cai ems men Se a 
(e.g., primarily the candidate A arning throughout community. 
* talks throughout the lesson datas. dee a lesson and adjusts 
There are inaccuracies in while students sit and listen wohl siica’shrnieahiGut instruction for whole class. Students independently 
presented content. or take notes). e ms facilitate their own work 


the lesson. either in a whole group, 
small group, pairs, or 
individually, choosing how to 


advance their learning. 


TPEs and Elements: TPE 1, Elements 5, 8; TPE 2, Element 5; TPE 4, Element 4 


Primary Sources of Evidence: 
e 3 Annotated Video Clips 


Content-Specific Pedagogy 
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Multiple Subject 


Learning About Students and Planning Instruction 


Step 3 Rubric 


Rubric 1.7 — Step 3: Reflect 


seoipuaddy : |] BUINjOA — S[apOW Wd _L JO Ayiqesedwioy jo uoljebijsenu] 


09-O'V 


Essential Question: How does the candidate analyze and describe the impact of their asset and needs-based lesson planning, teaching, and 
assessment of student learning and explain how the lesson supports this group of students and the three focus students? 


Level 1 


Candidate's reflection 
provides no connection 
between student assets and 
needs and impact on their 
planning, teaching, and 
monitoring of student 
learning. 


Candidate does not describe 

approach to support learning 
for the whole class and three 
focus students, 


Level 2 


Candidate's reflection 
demonstrates a minor or 
narrow understanding of 
what was learned about 
planning, teaching, AND/OR 
monitoring student learning 
in regard to students’ assets 
or needs. 


Candidate describes 
approach to support learning 
for the whole class OR three 
focus students. 


TPEs and Elements: TPE 1, Element 1; TPE 6, Element 1 


Primary Source of Evidence: 
* Written Narrative: Reflection on What You Learned 


Level 3 


Candidate connects the 
importance of knowing 
students’ assets and needs 
to student learning, and 
analyzes and describes how 
knowing this information can 
lead to the development of 
instruction that is engaging, 
challenging, and motivating 
to learners, including the 
whole class and three focus 
students. 
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Level 4 


All of Level 3, plus: 


Candidate provides a clear 
rationale for how and why 
adaptations to instruction 
were or were not made 
during the lesson to meet 
whole class, group, and/or 
individual student needs. 


Level 5 


All of Levels 3 & 4, plus: 


Candidate demonstrates a 
clear understanding of the 
principles of UDL regarding 
the development of flexible 
learning environments that 
can support individual 
learning differences, 
allowing for an inclusive 
classroom, and applies that 
understanding to an analysis 
of the planning and 
implementation of this 
lesson. 
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CalTPA Performance Assessment Guide 


Multiple Subject 


Rubric 1.8 — Step 4: Apply 


Step 4 Rubric 


Glossary 


Essential Question: How will the candidate apply what they have learned in Cycle 1 about students’ learning to next steps for instruction to 
strengthen and extend students’ understanding of content and develop academic language? 


Level 1 


Candidate description of 
future instruction for 
students is not connected to 
what was learned by 
planning, teaching, 
assessing, and/or reflecting 
on the lesson taught. 


OR 


Candidate does not describe 
next steps for instruction. 


Level 2 


Candidate provides a vague 
description of future 
instruction for students that 
is partially related to 
promotion of content 
learning and development of 
academic language. 


Candidate describes next 
steps for instruction that are 
unconnected to what was 
learned about students. 


Level 3 


Candidate applies what they 
have learned to describe 
future instruction for 
students that is designed to 
strengthen and extend deep 
content learning and 
academic language 
development for all 
students. 


Candidate provides next 
steps for instruction, citing 
evidence of student learning 
assessed during the lesson. 


TPEs and Elements: TPE 3, Element 2; TPE 4, Element 4; TPE 6, Element 1 


Primary Source of Evidence: 
e Narrative: Application of What You Learned 
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Level 4 


Candidate describes 
targeted instructional 
adaptations to support, 
strengthen, and extend 
whole class, group, and/or 
individual student learning 


needs during future lessons. 


Level 5S 


All of Level 4, plus: 


Candidate describes in detail 
how to support all students 
in an inclusive, safe, and 
positive learning 
environment (UDL 
strategies), explaining what 
steps they will take to 
ensure that all students are 
welcome to be part of the 
class community and 
discourse. 


Candidate's response 
demonstrates that they 
understand all students can 
learn when assets and 
learning needs are the focus 
of instruction. 
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Appendix 4.P: CalTPA Cycle 2 Rubrics for Multiple Subject 


CalTPA Performance Assessment Guide 


Multiple Subject 


Rubric 2.1 — Step 1: Plan 


Level 1 


Candidate's learning segment 
includes learning goal(s) that 
are not based on students” 
prior content knowledge and 
modeling, or scaffolding is not 
Clearly described or is not 
appropriate, 

OR 

Assessments are not included 
or are not purposefully 
connected to content-specific 
learning goalls). 


OR 


Student grouping Is not 
determined or rationale for 
grouping is not provided. 


Candidate's learning goal{s) in 
the learning segment are 
loosely based on students’ 
prior content knowledge and 
modeling, or scaffolding is not 
clearly described. 


Assessments check for rote 
knowledge of content or are 
only partially connected to 
content-specific learning 
goal(s). 


Student grouping within the 
learning segment may not be 
conducive to the type of 
lessons being planned, and 
reasonable rationale Is not 
provided, 


Step 1 Rubrics 


Candidate's learning segment 
includes manageable and 
appropriate learning goals 
that clearly build on students’ 
prior content knowledge. 


Candidate clearly identifies 
the multiple kinds of evidence 
they will look for to determine 
that students met the learning 
goalls) and the assessment(s} 
they will use to make this 
determination. 


Learning segment includes 
learning activities that are 
appropriately engaging, 
challenging, and accessible for 
students, and grouping 
strategies are appropriate. 
Strategies include adaptations 
and accommodations that will 
assist students to reach 
learning goals in multiple 
ways. 


Essential Question: How does the candidate's learning segment plan provide appropriate content-specific learning goals and assessments 
that offer multiple ways for all students to demonstrate knowledge? 


Level 4 


All of Level 3, plus: 


planned to develop deep 
understanding of content 
through active learning 
(product, process, 


to meet, in multiple ways, 
content-specific learning 
goal(s), 


Instruction and assessment 
are purposefully chosen and 


performance) and academic 
language to support students 


instructional Cycle 2 
Assessment-Driven Instruction 


Level 5 


All of Levels 3 & 4, plus: 


Candidate's plan includes 
individualized and whole class 
adaptations and 
accammodations that are 
purposefully and clearly 
drawn from the classroom 
context, resulting in an 
inclusive learning 
environment, 

Students have opportunities 
to independently facilitate 
their own work in a whole 
group, small group, pairs, or 
individuelly. 
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instructional Cycle 2 


CalTPA Performance Assessment Guide 
Assessment-Driven Instruction 


Multiple Subject 


TPEs and Elements: TPE 1, Elements 1, 4; TPE 3, Elements 1, 2, 6; TPE 4, Elements 4, 7, 8; TPE 6, Element S 
Primary Sources of Evidence: 

« Learning Segment Template 

* Written Narrative: Assessment Descriptions 

¢ Formal Assessment Rubric and/or Scoring Criteria 
Content-Specific Pedagogy 
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CalTPA Performance Assessment Guide 
Multiple Subject 


—_e—e———n ii 


Rubric 2.2 — Step 1: Plan 


Level 1 Level 2 


The assessments (including 
scoring criteria), learning 
activities, and instructional 
strategies of each lesson are 
aligned to meet the learning 
goal(s). 


The assessments (including 
scoring criteria), activities, 
and strategies of the 
learning segment are 
misaligned in ways that will 
hinder students’ access to 
learning goal(s). 


OR 


The assessments (including 
scoring criteria), activities, 
and strategies of the 
learning segment are 
partially aligned in ways that 
could limit students’ access 
to learning goal(s). 


Lessons bulld on one 
another to develop students’ 
higher-order thinking skills 
(analysis, synthesis, 
evaluation, interpretation, 
transfer), academic 
language, and concepts and 
skills that are likely to 
support students to engage 
with the learning segment 
content. 


There are inaccuracies in 
lesson content. 


TPEs and Elements: TPE 1, Element 1; TPE 3, Elements 2, 5; TPE 5, Elements 1, 3 
Primary Sources of Evidence: 
* Learning Segment Template 
* Written Narrative: Assessment Descriptions 
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Essential Question: How does the candidate plan a learning segment where assessments, instructional strategies, and learning activities align 
and provide a progression of learning that develops students’ concepts and skills to achieve the learning goal(s)? 


All of Level 3, plus: 


Learning segment plan 
builds in opportunities that 
provide multiple access 
points (different ways to 
learn content visually, 
through writing or reading, 
listening, acting out, 
verbalizing) to learning 
content and multiple modes 
(different ways for students 
to show what they know 
through writing, speaking, 
performing) to demonstrate 
learning of content. 


Instructional Cycle 2 
Assessment-Driven Instruction 


LevelS 


All of Levels 3 & 4, plus: 


Candidate’s learning 
segment pian is sufficiently 
flexible to provide for an 
inclusive learning 
environment reflective of 
students’ assets and needs 
where all students clearly 
have equal access to content 
by engaging in challenging 
learning activities (UDL with 
multiple means of 
representation, action and 
expression, and 
engagement) that develop 
academic language and 
higher-order thinking. 
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Instructional Cycle 2 


CalTPA Performance Assessment Guide 
Assessment-Driven Instruction 


Multiple Subject 


Step 2 Rubrics 
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Rubric 2.3 — Step 2: Teach and Assess 


Essential Question: How does the candidate support student development of academic language in relation to the content-specific learning 
goal(s)? 


Level 1 Level 2 


Informal assessment(s) are Candidate uses informal 
not used to monitor language | assessment(s) to loosely 
development. monitor students’ academic 
: : language development OR 
Candidate does not provide candidate has a superficial 


language 
. understanding of the 
adaptations/accommodations faiioninge! desearkis of ifve 


On panedes lessons, providing minimal 
adaptations/accommodations Ad 6 
adaptations or 


that do not align with 5 Arwcaraitat tat 
language demands of the ; 
lesson content. 


Level 3 


Candidate uses specific 
learning activities to provide 
opportunities for students to 
develop academic language 
specific to the language 
demands of the learning 
segment and content- 
specific learning goals. 


Language demands are 
generally addressed for the 
whole class as a group 
through instructional 
adaptations to support 
content learning. 


TPEs and Elements: TPE 1, Elements 1, 8; TPE 3, Element 5; TPE 5, Element 8 


Primary Sources of Evidence: 
* 4 Annotated Video Clips 


* Written Narrative: Analysis of Informal! and Student Self-Assessments 


Content-Specific Pedagogy 


Copyright © 2018 by the California Commission on Teacher Credentialing 
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Level 4 


All of Level 3, plus: 
Candidate differentiates 
instruction to address the 
needs of individual learners 
relative to the language 
demands of the lessons 
through specific adaptations 
or accommodations. 


Level S 


All of Levels 3 & 4, plus: 


Candidate provides 
evidence-based, 


developmentally appropriate 


individualized, small group, 
and whole class academic 
language adaptations and 
accommodations, resulting 
in an inclusive environment 
where all students are 


actively engaged in learning. 
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CalTPA Performance Assessment Guide 
Multiple Subject 


Rubric 2.4 — Step 2: Teach and Assess (educational technology) 


Level1 Level 2 


Candidate does not provide Candidate uses educational 


demonstrate the content- 
specific learning goal(s). 


Primary Sources of Evidence: 
* 4Annotated Video Clips 


Copyright © 2018 by the California Commission on Teacher Credentialing 
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Candidate provides students 
with opportunities to use 
information in a one-to- educational technology to 
many learning environment | achieve and/or demonstrate 
for a drill or practice type the content-specific learning 


Opportunities for students to | technology to present 

use or access educational 

technology to learn or 

demonstrate the content- 

specific learning goal(s). activity to achieve and/or goal(s). 


TPEs and Elements: TPE 3, Elements 6, 8; TPE 4, Elements 4, 7, 8 


Essential Question: How does the candidate incorporate educational technology (digital/virtual tools and resources) to provide opportunities 
for students to achieve and/or demonstrate the content-specific learning goal(s)}? 


Level 4 


All of Level 3, plus: 


Candidate provides students 
choice of a selected range of 
educational technology to 
use to achieve and/or 
demonstrate content- 
specific learning goal(s). 


Students use educational 
technology to facilitate and 
enhance peer or group 
collaboration in or beyond 
the classroom (e.g., online 
documents, email pen pals, 
online interviews with 
students at another schoo! 
or in another state or 
country). 


instructional Cycle 2 
Assessment-Driven Instruction 


level 5 


All of Levels 3 & 4, plus: 


Students are knowledgeable 
enough about educational 
technology to independently 
choose which educational 
technology resources they 
want to use to achieve, 
demonstrate, and extend 
beyond the learning goal(s) 
of the lesson (e.g., students 
choose to use a graphics 
Program to create and add 
images to their online 
document without being 
told to do this by the 
candidate). 
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instructional Cycle 2 


CalTPA Performance Assessment Guide 
Assessment-Driven Instruction 


Multiple Subject 
a 
Rubric 2.5 — Step 2: Teach and Assess 


p understanding of content (higher-order 


Essential Question: How does the candidate use informal assessment to monitor students’ dee 
thinking) and adjust instruction to meet the needs of all learners? 


Levell Level 2 Level 3 Level 4 Level 5 


All of Level 3, plus: All of Levels 3 & 4, plus: 


Candidate provides Assessments are 

adaptations or purposefully used to 
accommodations during advance or deepen learning 
informal assessments for and are administered in a 
specific students to meet transparent and 

their unique learning needs | intellectually safe way that 
and makes targeted celebrates student progress 
adjustments to their and supports growth for all 
instruction. students (e.g., candidate 
reviews learning goal[s] with 
students so that they are 
aware of exactly what they 
are expected to know and be 
able to demonstrate; 
candidate notes progress of 
learning first, then reviews 
what students have not yet 
demonstrated). 


Candidate’s use of informal 
assessment monitors 
students’ higher-order 
thinking (analysis, synthesis, 
evaluation, interpretation, 
transfer), resulting in an 
understanding of whole class 
progress toward meeting the 
learning goal(s) and deep 
understanding of content. 


Candidate's use of informal 
assessment monitors 
students’ lower-order 
thinking skills (memorize, 
duplicate, repeat, define), 
resulting in a limited view of 
students’ deep 
understanding of content. 


Candidate’s use of informal 
assessment is insufficient for 
monitoring students’ deep 

understanding of content. 


OR 


Assessments are Irrelevant 
to measuring content- 
specific learning goal(s} or 
are a cursory check for 
understanding or asking 
students how they feel. 


Assessments are too few to 
lead to instructional 
adjustments or miss key 
concepts of lesson content. 


Monitoring is sufficient to 
inform teaching in the 
moment, and candidate 
adjusts instruction for the 
whole class based on 
assessment results. 


Students are provided 
multiple ways to 
demonstrate their learning 
(e.g., verbal, written, 
drawing, ciagramming, 
performing, and more) 
through a range of informal 
assessments, 


TPEs and Elements: TPE 1, Elements 1, 8; TPE 3, Element 3; TPE 4, Elements 3, 4; TPE 5, Elements 1, 2 


Primary Sources of Evidence: 
® 4 Annotated Video Clips 
¢ Written Narrative: Analysis of Informal and Student Self-Assessments 


Content-Specific Pedagogy 
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CalTPA Performance Assessment Guide Instructional Cycle 2 
Multiple Subject Assessment-Driven Instruction 


Rubric 2.6 — Step 2: Teach and Assess 


Essential Question: How does the candidate engage students in self-assessment to build their awareness of what they have learned and 
support their progress toward meeting learning goal(s)? 


Level 1 Level 2 Level 4 Level 5 


Candidate does not provide 
criteria or rubric for self- 
assessment. 


OR 


Candidate provides criteria 
or rubric for self-assessment 
that is either not linked to 
learning goal{s) OR is too 
broad to be helpful in 
students’ self-assessment of 
their own understanding of 
how they are progressing 
toward meeting learning 
goal(s). 


Candidate provides criteria 
for self-assessment by which 
students build their 
awareness of what they 
have learned and what they 
need to continue to learn to 
measure their own progress 
toward meeting learning 
goal(s). 


All of Level 3, plus: 


Criteria for self-assessment 
directs students to analyze 
complex content, specific 
concepts, or processes that 
engage them in higher-order 
thinking (analysis, synthesis, 
evaluation, interpretation, 
transfer). 


All of Levels 3 & 4, plus: 


Candidate helps individual 
students use self-assessment 
results to establish revision 
to student work to improve 
process, product, or 
performance. 


Candidate does not engage 
students in self-assessment. 


Candidate supports students 
in understanding criteria and 


Candidate includes 
adaptations and 


Candidate provides 


inadequate direction or how to conduct the self- accommodations for self- 
practice for students to learn | assessment. assessment based on 

to conduct the self- individual student assets and 
assessment. 


learning needs. 


TPE and Element: TPE 5, Element 3 


Primary Sources of Evidence: 
« 4 Annotated Video Clips 
* Written Narrative: Analysis of informal and Student Self-Assessments 
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instructional Cycle 2 


CalTPA Performance Assessment Guide 
Assessment-Driven Instruction 


Multiple Subject 


a 
Rubric 2.7 — Step 2: Teach and Assess 


Essential Question: How does the candidate use results of i nformal assessments, including student self-assessment, to provide feedback to 
students about how to improve or revise their work to continue progress toward and/or beyond the learning goal(s)? 


Level 1 Level 2 Level 3 Level 4 Level 5 


All of Level 3, plus: All of Levels 3 and 4, plus: 
Candidate connects Candidate differentiates how 
feedback to students’ prior they provide feedback to 
learning to draw attention to | students based on individual 
broader understandings and | tearning needs. 

skills, knowledge, or abilities 
related to content-specific 
learning goalls). 


Candidate uses assessment 
results to provide feedback 
to students based on criterla 
for performance that 
clarifies what was done well, 
where there are errors, and 
what they need to do next 
(to revise or advance 
learning) to continue 
progress toward meeting the 
content-specific learning 
goal(s). 


Candidate uses assessment 
to provide feedback that 
either focuses on student 
errors and/or minimally 
clarifies what students need 
to improve or revise their 
work. 


Candidate does not provide 
assessment feedback to 
students. 


OR 


Feedback is inaccurate or 
irrelevant. 


Informal assessment 
feedback informs continual 
improvement for the whole 
class and individuals and 
leads the candidate te make 
purposeful decisions about 
next steps for student 
learning. 


Candidate does not explain 
to students how to use 
feedback to advance 
learning of content. 


TPE and Elements: TPE 5, Elements 1, 3, 5 


Primary Sources of Evidence: 
* 4 Annotated Video Clips 
* written Narrative: Analysis of Informal and Student Self-Assessments 


Copyright © 2018 by the California Commission on Teacher Credentialing 
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CalTPA Performance Assessment Guide Instructional Cycle 2 
Multiple Subject Assessment-Driven Instruction 


Step 3 Rubric 


ee EEE 
Rubric 2.8 — Step 3: Reflect 


Essential Question: How does the candidate analyze the formal assessment results based on the scoring criteria and identify and describe 
emerging learning patterns and trends for the whole class in relation to the learning goal(s)? 


Level 3 Level 4 Level 5 


All of Level 3, plus: 


Level 2 


Candidate does not analyze Candidate’s analysis of Candidate’s analysis of the All of Levels 3 & 4, plus: 


formal assessment results, | formal assessment results is | formal assessment results Candidate accurately Formal assessment Is used to 

or analysis is inaccurate. incomplete and results in a accurately describes describes learning patterns advance and deepen 

OR minimal or cursory performance forthe whole | or trends for individuals, students’ learning through 
description of whole class class in relation to the citing clear evidence from analysis and transfer of 

Assessment scoring criterla performance in relation to scoring criteria/rubric and the student work samples. knowledge. 

or rubric does not measure the learning goai(s). identifies general patterns ; a 

content-specific learning individualized feedback is and trends in relation to the | Candidate identifies Assessment is administered 

goal(s). not provided. learning goal(s). students’ partial and In a transperent and 

developing understanding of | intellectually safe way that 

Formal assessment Is used to | Assessment scoring content. celebrates student progress, 
identify deficits or tack in criteria/rubric align with the allows students to take risks, 
students’ learning capacity learning goal(s) and enable and clearly supports growth | 


the candidate to score 
student work consistently. 


and is not educative 

(e.g., students do not 
advance their knowledge by 
completing the assessment, 
no application or transfer is 
evidenced; students 
demonstrate rote knowledge 
or lower-order thinking 
skili[s}). 


for all students as they strive 
to meet the learning goal(s). 


TPE and Elements: TPE 5, Elements 2, 8 
Primary Sources of Evidence: 

* Scored Formal Assessments from 3 Students 

* Narrative: Analysis of Assessment Results and Reflection 


Copyright © 2018 by the Califormia Commission on Teacher Credentialing 
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instructional Cycle 2 


CalTPA Performance Assessment Guide 
Assessment Driven Instruction 


Multiple Subject 


Step 4 Rubric 


ee 
Rubric 2.9 — Step 4: Apply 


Essential Question: How does the candidate use the analysis of assessment results to plan and teach a follow-up learning activity and provide 
a rationale for the activity choice, citing evidence? 


Level 1 Level 2 Level 3 level 4 


All of Level 3, plus: 
Candidate provides specific 
adaptations or 
accommodations for 
individuals to increase 
access and meaningful 
engagement. 


All of Levels 3 & 4, plus: 


Follow-up learning activity, 
whether a re-teaching or 
extension activity, is focused 
on deepening key 
performance skills and 
understanding of content 


Candidate applies what was 
learned from an analysis of 
assessment results to plan 
and teach a content-specific 
follow-up activity. 


Candidate loosely applies 
what was learned from 
reviewing assessment results 
to plan and teach follow-up 
activity, OR analysis of 
assessment results is limited 
and does not reflect class 


Candidate does not relate 
what was learned from 
reviewing assessment results 
to plan and teach follow-up 
activity. 


OR 


If re-teaching, the candidate 


Candidate's rationale for abilities in regard to the ek sonadaha intense ope i ~ 
activity choice is not clearly learning Sais of the hey pore purerts se iirc peeing arias 
related to content-specific learning segment. meet learning goaks). If ct . luati : 
learning goal(s) taught In the REO A Se nee! eenaaes a ri nsf id 
larch ceaernarie wee Candidate's rationale for activity, the activity deepens Se cs oer er)an 
Ceres rate ee activity choice Is unclear, and advances students’ develops academic 

and evidence citations do learning. language. 


provided. not align with why activity 


was planned and taught, 


Candidate provides a 
rationale for activity based 
on analysis of student 
performance during the 
learning segment and cites 
evidence from assessment 
results that supports choice 
of follow-up activity. 


Copyright © 2018 by the California Commission on Teacher Credentialing 
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CalTPA Performance Assessment Guide 


Instructional Cycle 2 
Multiple Subject 


Assessment Driven Instruction 


TPEs and Elements: TPE 5, Elements 2, 3, 8; TPE 6, Element 1 


Primary Sources of Evidence: 
* Re-Teaching or Extension Activity Description 
* Annotated Video Clip of Follow-Up Instruction 
Content-Specific Pedagogy 
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HUMAN RESOURCES RESEARCH ORGANIZATION 


Appendix 4.Q: CalTPA Scorer Process Flow 


Rubric 1,3 Scorer Process Flow 


ESSENTIAL QUESTION: How does the candidate plan instruction using knowledge of F52’s (student with identified special needs} 
assets and needs* to support meaningful engagement with the content-specific lesson goals(s)? 

PRIMARY SOURCE OF EVIDENCE: Written Narrative: Getting to Know Your Students (Description of Focus Student 2 Assets and 
Needs}; Lesson Plan; Written Narrative: Lesson Pian Rationale; Related Instructional Kesources and Materials 

*EXAMPLES; Prior academic knowledge; social-emotional development; social identity; cultural and linguistic resources and funds 
of knowledge; prior experiences and Interests; developmental considerations; assistive technologies; learning challenge (identified 
(EP goals; focus of 504 plan or MTSS support; or need for greater challenge through GATE) 


LEVEL 3 Evidence: 


Do the planned accommodations attend to \EP/504/GATE goals and identified assets and needs between 
F52's current developmental or academic abilities and the demands of the lesson, allowing FS2 to fully YES/NO 


access content and meet learning goals? 


Does the candidate provide a cogent rationale in planning for scaffalding of activities and strategies to YES/NO 
accommodate F52’s progress toward meeting learning goals)? 


¢ all VES," goto Levels “> ifone or more "NO," go to Level 2 


Level 4 Evidence: All of Level 3 PLUS: 


"Does the candidate's lesson plan build 
on and highlight fS2's assets and YES/NO 


LEVEL 2 Evidence 


De the planned accommodations minimally 
attend ta |EP/504/GATE goals or not identify 
needs between PS2's current developmental or 
academic abilities and the learning demands of 
the lesson? 


Does the candidate's plan include limited or - 


learning needs? 


-_ inappropriate scaffolding, support(s), or 
| ” Seaske accommodations to address learning needs of 
fall "VES," goto level 5, \f one or more “NO,” Score is 3. FS2 during the lesson? 


Does the candidate reduce the rigor of learnin 
LEVEL 5 EVIDENCE: All of Levels'3 and 4 PLUS: ies in ways 


activities and instructiona) strategies in ways YES/NO 
Does the candidate plan a lessen using 


that limitstudent access to content-specific 
‘ earring goals)? 

UDL that purposefully creates an inclusive 

environment to support FS2's content- YES/NO 

specific learning as part of the whole class 


community? we ; Ng 
if all “YES,” score ts 2. If one or more "NO," go to Leve! t, 


Does the candidate's rationale cite 

evidence-based practice|s) appropriate ta yES/NO 
the IEP, 504 plan, or other pre- 

determined learning goals for FS2? 


LEVEL 1 Evidence 


Does the candidate not connect knowledge of 
FS2's assets, needs, or lEP/504/GATE goals to YES/NO 
lesson plan? =O 


eee Does the candidate primarily display deficit YES/NO 
if all “YES,” seoreisS if one or more “NO,” score js 4. thinking in relation to FS2? =OR 


Does the planning for gifted students onty 

include additional, similar work and tot expand YES/NO 
or extend their developmental or academic 

learning? 


tone ce roore “YES,” scare 1. 
Copyright ® 2016 by tne California Commission on Teacher Credentialing 
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HUMAN RESOURCES RESEARCH ORGANIZATION 


Appendix 4.R: CalTPA Score Report (Draft) 


a ( F 
+ | catTPA Assessment Results Report 
Understanding Your CalTPA Assessment Results Report 
Overview 


Ph 
Your CalTPA Assessment Results Report provides the results for the cycle(s) that you submitted for this reporting 
period. If you re-submitted an instructional cycle, your report includes the new results on that instructional cycle 
Results are reported to the Commission on Teacher Credentialing and the Commission-approved educator 
Preparation program you selected during registration 


Cautions, Your CalTPA Assessment Results Report is for your records only. This assessment was not designed 
to compare your performance to that of other candidates. Your score is used to compare your performance to the 
performance level set by the Commission on Teacher Credentialing. 


Rubric Performance Summary 


This section indicates the most recent results you have earned on the cycle(s) scored during this reporting period. 
For each rubric, this table provides a description of your performance, the score you earned, and the total cycle 
score (sum of scores across all rubrics). This information may help you identify your relative strengths and areas 
for improvement. 


Performance description information is provided only for any cycles scored during this reporting period. If a 
condition code has been applied instead, the description provides information indicating the requirement not met. 
Please see “Condition Codes” below for more information. 


Rubric Scores. Each rubric consists of from one to five performance levels, with a score of five (5) indicating high 
performance. For any rubric assigned a letter (e.g., “A1") instead of a numeric value. some or all of the 
submission is deemed unscorable in accordance with the CalTPA Submission Requirements. As indicated in the 
CalTPA Submission Requirements, any cycle receiving a condition code will be unscorable and reported overall 
as “N/A* for Not Applicable. See “Condition Codes” below for more information. 


Cycle Performance Summary 


The Cycle Performance Summary indicates the cycle status and reporting date for all submitted and scored 
cycles and your overall CalTPA requirement status. Cycle status will be reported as “Pass” or “Did Not Pass" for 
any cycle submitted and scored. If you received a condition code for any rubric, the cycle in which that condition 
code was assigned will indicate “N/A” for Not Applicable. Please see “Condition Codes" below for more 
information. CalTPA Requirement Status indicates your status for the entire assessment and will be reported as 
“Requirement Not Yet Met” or “Requirement Met.” 


Retaking CalTPA 


Refer to the Get Results/Retake Assessments page on the program website at wav ctcexams nesinc.com for 
registration and submission requirements for retaking CalTPA. 


Condition Codes 


Condition codes are applied when a submission does not meet the requirements as defined in the CalTPA 
Submission Requirements. Complete descriptions of these codes are available on the Assessments/CalTPA/ 
Policies page on the program website at www ctcexams nesinc com, Details indicating the requirements not met 
are shown in the Rubric Performance Summary for any rubric(s) in which you received a condition code. 


« Each rubric for which a condition code is assigned will receive a letter and number (instead of a numeric 
score) indicating which condition code was applied. 

e All other Rubrics within the cycle will receive a condition code "X," indicating that no numeric score was 
assigned, due to condition code(s) elsewhere in the cycle. 

e Any cycle containing an indicator with a condition code(s) will be reported as Not Applicable, or “N/A.” 
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HUMAN RESOURCES RESEARCH ORGANIZATION 


Assessment Results Report 


TPA USE Rwox Social Security Number: XXX-X0-O000 
123 Example Lane Submission Deadline: 10/25/2018 
Example CA 12345 Reporting Date: 11/29/2018 


Your assessment results will be reported to the Commission on Teacher Credentialing and the following Commission-approved 
educator preparation program; Sample University 


Multiple Subject Cycle 1: Learning About Students and Planning Instruction (Mathematics) 


Rubric Performance Summary 


Cycle Step and Rubric p secede 


Step 1: Plan 
ee | 


Candidate's lesson plan includes goal(s) that are loosely built on students’ price content knowledge, and scaffolding ts not likely 
lo support student learning. Candedate identifies evidence of learning that focuses on rote knowledge of content or is only 
partially connected to content-specific learning goal(s). Plan for student grouping is not conducive to the type of lesson beng 
planned, and rationale for approach is not clear. 


Plan instruction using knowledge of FS1‘s assets and needs 


Planned adaptations and/or accommodations minimally connect FS1's assets of learning needs to the expected reading, writing, 
listeneng, or speaking abilities required of the content taught in the lesson 
Rubric | Plan instruction using knowledge of FS2's assets and needs 
1.3 


Planned accommodations minimally attend to [EP/S04/GATE goals or do not identify needs between FS2's current 
developmental or academic abilities and the learning demands of the lesson. Candidate's plan includes limited or inappropriate 
scaffolding. support(s), or accommadations to address learning needs of FS2 during the lesson. Candidate reduces the rigor of 
learning activities and instructional strategies in ways thal limit student access to content-specific learning goal(s). 


| Reese | Plan instruction using knowledge of FS3's assets and needs 


Planned activities and/or strategies and assessment during or outside of the lesson may be responsive to the life experience(s) 
of FS3, but it is not clear that the supports contribute to establishing a safe and positve environment and promote FS3's 
well-being. Candidate minimally connects knowledge of FS3's assets and needs to selection of activities, strategies, and informal 
assessment OR provides a superficial understanding of student needs and how to create a safe and positive environment for 


learning during or outside of the lessor. 


Step 2: Teach and Assess 
Cra Establish clear learning expectations and maintain a positive learning environment 


Candidate sets vague learning expectations during the opening of the lesson and minimally connects lesson to prior 
learning. Candidate's annotations minirnalty explain strategy(ies) attempted to establish a positive and safe learning 
environment. It & not clear that strategies will support students to access and meet content-specific learning goal(s). 


Engage students and monitor understanding 


Instruction and assessment require students to engage in lower-order thinking about content, AND/OR strategies engage students Le | 


in passive learning of content during the lesson (¢.9., primarily the candidate talks throughout the lesson while students sit and 
listen or take notes), 


Step 3: Reflect 


| Rubre Analyze & describe the impact of planning, teaching and assessment of student learning 


Candidate's reflection provides no connection between student assets and needs and impact on their planning, teaching, and 
monitoring of student leaming. OR Candidate does not describe approach to support learning for the whole class and three focus 


students 
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+ | Assessment Results Report 


TPA USERwoax Social Security Number: XXX-X0-0000 


Step 4: Apply 


Candidate description of future instruction for students is nol connected to what was learned by planning, teaching, assessing, 
and/or reflecting on the lesson taught. OR Candidate does not describe next steps for instruction. 


Cycle 1 Total Score 


nstruction to strengthen and extend students* understanding of content 


Apply learning and provide next steps for i 
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Chapter 5. Appendix 


Appendix 5.A: Site Visit Notes from Observation of FAST SVP Passing Standard 
Workshop 


Fresno Assessment of Student Teachers (FAST) 
Observation of Passing Standard Workshop, May 14, 2018 
Fresno State University 
Site Visitation Project (SVP) 


The site visit occurred on May 14, 2018 from 2:00 — 4:00 pm (PT). 


The purpose of the workshop was to check whether the existing rubric for a level 2 (passing) 
candidate reflects reasonable expectations for beginning teachers for the Site Visitation Project 
(SVP) assessment. 


For the SVP, students are supposed to plan, teach, and evaluate a 20- to 45-minute lesson that 
is observed by a University Coach and videotaped. The lesson plan and instruction should 
address goals and skills aligned with the adopted California content, English Language 
Development (ELD), and English Language Arts (ELA) standards and frameworks. The 
students are supposed to submit the written lesson plan at least 3 days prior to implementation. 
The lesson is observed by a University Coach and/or a subject-matter expert and videotaped. 
After the student watches the video, he or she evaluates lesson planning and implementation, 
and selects a segment of the video to demonstrate subject-specific pedagogy. For each of the 
three activities (planning, implementation, and reflection) there is a scoring rubric consisting of 
three entries/ evaluation areas: subject-specific pedagogy, applying knowledge of students, and 
student engagement. There are 4 levels in which students may be scored for each of these 
rubrics: 1=Does not meet expectations; 2=Meets expectations (passing level); 3=Meets 
expectations at a high level; and 4=Exceeds expectations (FAST SVP F17 field test guidance, 
2017). 


The group of panelists consisted of 9 participants, all members of Fresno State University 
teacher preparation program in the capacity of site coordinators or multiple or single subject 
instructors. 


The participants were familiar with the assessment rubric and scoring, and with student 
performance. Due to this, the panelists were not administered portions of the assessments. 
Participants received the following documents in email before the workshop, and were also 
provided with the printout of these documents in the beginning of the workshop: 


1. Passing Standard Workshop Agenda SVP 


2. Class Profile SVP FAST2.0 -- A template the teacher candidate may use to prepare for 
the SVP, including Information for instructional planning, class summary, selection of the 
three focus students and explanation of why these students were selected and their 
learning needs and how the candidate plans to make content more accessible to the 
learning needs of the three focus students 


3. Lesson Plan Template - A template to be used by a candidate teacher to provide an 
outline of the lesson plan 
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4. SVP 2.0 Fall - Contains the overview of SVP, the general directions for the teacher 
candidate, instructions on how to prepare for the site visitation project (SVP), parts of the 
SVP, and the evaluation rubric for Lesson Planning, Observation of Lesson, and Self- 
Evaluation of Lesson. 


5. SVP rubric passing standard - The rubric for levels 1 and 2 only 


6. Activity or Strategy Table SVP 2.0 - A document that candidates use as part of the SVP 
to describe instructional activities they will be using and to show the relationship 
between the activities or strategies and the four categories: subject specific pedagogy, 
acquisition of academic language, knowledge of students, and student engagement. 


At the beginning of the workshop, the participants introduced themselves and explained their 
role in the FAST assessment process. Then, the facilitator introduced the main purpose of the 
workshop (to check whether the existing rubric for a level 2 candidate reflects reasonable 
expectations for beginning teachers). The facilitator introduced the history of the FAST 
assessment development, stating that the preliminary passing standard was developed in the 
fall of 2017 with the assistance of mentor teachers and site supervisors. The teacher education 
program received feedback from mentor teachers and site supervisors on the assessment and 
the rubric and made changes based on that information. The purpose of the present meeting 
was to look only at the SVP passing standard and to determine if what candidates are asked to 
do at level 2 is a reasonable expectation for beginning teachers. 


The facilitator then handed out the print documents and explained their purpose. She reviewed 
the structure of the SVP assessment (planning, implementation, self-reflection) and the three 
rubrics associated with each of those tasks (subject-specific pedagogy, applying knowledge of 
students, and student engagement). She also reviewed the passing score—the student has to 
get a 2 in all rubrics of the assessment to get a score of 2 overall. If the student gets a1 ona 
rubric, he or she needs to revise and resubmit that portion of the SVP assessment. 


The facilitator then introduced the brainstorming activity and noted that the participants will be 
focusing on three main areas for these sections: lesson planning, implementation, and self- 
evaluation during this activity. The purpose of the brainstorming activity was outlined as follows: 
“When you think about a competent beginning teacher, but not necessarily outstanding, 
beginning teacher — what characteristics should you be seeing?” The brainstorming activity took 
approximately 1 hour 15 minutes. As the panelists were brainstorming, the facilitator was 
recording their suggestions in a Word document projected on the overhead screen. 


During the activity, the panelists listed the KSAs for the planning and teaching parts that they 
think a beginning teacher should have. The panelists stressed the importance of setting high 
expectations for the candidates and ensuring that they are aware of what it takes to become a 
highly qualified teacher. The facilitator reminded the panelists that they should be thinking about 
a beginning teacher who may not have the characteristics of an experienced and successful 
teacher. To facilitate the differentiation between candidates who are not meeting the passing 
standard and those who are meeting the standard, the facilitator suggested that the panelists 
provide examples of teacher performance that they themselves observed that was above or 
below the passing standard, and that the panelists recall what specific tasks were challenging 
for them as beginning teachers and why. The panelists were able to come up with some 
behaviors characteristic of an unsuccessful teacher candidate that they observed during site 
visits. The facilitator prompted the panelists to think about whether those actions by the teacher 
candidates would mean that they would fail the SVP portion of the assessment and again 
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directed their attention to how the skills of a passing teacher candidate may be different from 
those of a non-passing teacher candidate. 


As the final part of the workshop (approximately 30 minutes), the panelists reviewed the three 
rubrics for three tasks (planning, implementation, reflection) for the two levels — 1 (Does Not 
Meet Expectations) and 2 (Meets Expectations). The purpose of the review was to evaluate 
whether the rubric reflects reasonable expectations of what beginning teachers should know 
and be able to do, and whether the rubrics are worded clearly. They discussed some wording 
that appeared vague to them (e.g., “little or no understanding”, “typical student”) and possible 
changes to the wording. Small changes were made to the wording; the consensus among the 
panelists was that the rubric for Level 2 reflects reasonable expectations for the KSAs of 
candidate teachers. The finalized rubric will be posted on the CTC web site. 


Overall, the panel appeared to be representative enough for the evaluation of the rubric content 
and appropriateness. The participants worked together effectively to reach consensus regarding 
their opinion of the appropriateness of the rubric. The process was conducted efficiently; the 
facilitator kept the discussion focused and was able to prompt the panelists to evaluate the 
rubrics using their experience and knowledge of teacher candidates and summarize their 
decisions. 
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SEARCH ORGANIZATION 


Appendix 5.B: CalTPA Standard Setting Policy Capture Activity Instructions 


CalTPA 


California Teaching 
Performance Assessment 


CalTPA Standard Setting Conference 


Standard Setting Policy Capture Activity 
Instructions 


In this activity, you will collaborate with panelists who also reviewed the same submissions for 
the pre-work assignment. Table assignments are posted on the PowerPoint slides. 


You will first spend time recalling each submission you reviewed prior to the conference and 
provide an individual rating for each, using “Form 1: Standard Setting Policy Capture— 
Individual” (provided by ES staff). Then you will discuss your ratings with other panelists at 
your table, with the goal of arriving at a consensus on the rating. As a group, you and the other 
panelists at your table will complete “Form 2: Standard Setting Policy Capture—Group” 
(provided by ES staff). 


After rating the first submission, you will move to your next table assignment and repeat the 
process for the second “pre-work” submission you reviewed (and so on). In total, six individual- 
and group-rating “rounds” will be completed by the end of the day (three submissions per two 
CalTPA cycles). 
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Table Activity Instructions 


You and other panelists at your table will have 30 minutes per “round” to complete the following 
activities. Please stay focused, refrain from off-topic discussion, and try to complete the activity 
within the time limit. Use the protocol below to guide how much time is spent on each 
component of the activity. The facilitator will guide you through each cycle and help you follow 
the protocol. 


Introductions: Make a brief introduction of your name and role in relation to 
the CalTPA. Please do not spend more than 3 minutes as a group introducing 
yourselves. Assign a table leader to keep the group focused and on track. 


3 minutes 


Recall the submission you reviewed and provide an individual (independent) 
rating on Form 1, including a brief rationale for your rating. PLEASE DO NOT 
DISCUSS YOUR RATINGS OR RATIONALE YET WITH OTHER 
PANELISTS AT THE TABLE. You may consult with others in the group to 
confirm you are recalling the correct submission. 


12 minutes 


Discuss your ratings with other panelists at your table and come to consensus on 
your group’s rating. Make sure everyone has had a chance to explain their 
individual ratings and that all voices have been heard. 


13 minutes 


/2minutes | Complete Form 2 with your table. 


Submit your INDIVIDUAL RATINGS (Form 1) and GROUP RATING 
(Form 2) to your facilitator. 


You will repeat this 30-minute process for each submission you reviewed. 
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Instructions for Completing Individual and Group Ratings 


Review your notes on the submission you reviewed for pre-work to refresh your memory. Make 
sure you are recalling the correct submission. Check the Submission [ID on Form 1. You may 
want to consult with others at your table to confirm you are reviewing the correct submission. 


Consider: 
e the content-specific aspect for this CalTPA credential area 


e the evidence (videos, artifacts, and written narratives) you viewed in this candidate's 
submission 
e the scores given to the submission, and 


e your understanding of the meaning of the CalTPA rubric levels 


Now, think about whether this candidate is "a teacher candidate who is just at the level of 
knowledge and skills required to perform effectively the job of a new teacher in California 
public schools." 


Form 1:$ Setting Poli ture—Individual 


The goal of this activity is to help the panelists at your table come closer together on what this 
passing standard might be, in order to narrow the range of cut scores under consideration. 
Depending on where you initially set your own passing standard, think about whether the 
submission you reviewed is: 


CLEARLY NOT performing effectively the job of a new teacher. This 
teacher has demonstrated one or more major problems in teaching knowledge 
or skills that require remediation and may need additional time and 
opportunity for learning and improvement. 
APPROACHING but NOT YET effective in performing the job of a new 
teacher. This teacher has demonstrated some strengths but has one too many 
issues in teaching knowledge or skill that will keep him/her from being 
effective. 
JUST MEETS your definition of performing effectively the job of a new 
teacher. This teacher has demonstrated some consistent strengths in teaching 
knowledge and skills and has a foundation on which to build. The teacher 
may have shown one or more minor flaws in teaching knowledge or skill that 
will likely improve with more time and experi ; 

CLEARLY MEETS your definition of performing effectively the job of a 
new teacher. This teacher has demonstrated clear strengths in teaching 
knowledge and skills, and a strong foundation for effective teaching. 


Clearly below 
the passing 
standard 


Just below 
the passing 
standard 


Just meets 
the passing 
standard 


Clearly meets 
the passing 
standard 
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How you define each of the ratings above will vary from other panelists depending on how you 
define “just meets” the passing standard. Remember the passing standard is framed as: 


“a teacher candidate who is just at the level of knowledge and skills required to 
perform effectively the job of a new teacher in California public schools." 


You have four rating levels to select from: 


e Clearly below the passing standard 
e Just below the passing standard 
e Just meets the passing standard 
e Clearly meets the passing standard 


PLEASE CHECK ONE RATING LEVEL ONLY. Then state the reason(s) that most 
influenced your rating. You may include your assessment of the candidate's performance on 
specific rubrics. The rationale you provide will help you as you discuss your rating with other 
panelists and help us draw patterns about how panelists justified their ratings. 


Form 2: dard Setti ‘olicy Captu rou. 


Following the completion of Form 1, discuss your rating with other panelists at your table and 
come to consensus on a table rating. Make sure everyone has had a chance to explain their 
individual ratings and that all voices have been heard. Then complete “Form 2: Standard Setting 
Policy Capture—Group” (one per table) for this submission. Finally, select a table leader who be 
prepared to discuss your table’s rating with all CalTPA standard setting panelists. 
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Appendix 5.C: CalTPA Standard Setting Final Passing Standard Recommendation 
Form 


Panelist 1D; _ Sle 
CalTPA Standard Setting Conference 
May 8-9, 2019 
Final Passing Standard Recommendations 


Cycle 1: 
1) Think about a teacher candidate who is just at the level of knowledge and skills required to 
perform effectively the job of a new teacher in California public schools. 


What total score (the sum of all rubric scores) of the CalTPA Cycle 1 represents the level of 
performance achieved by this individual? 


Cycle 1 


2) Given the committee-recommended passing standard, what (if any) additional condition should be 
applied? 


Yes No 


Apply additional condition?: 


individual rubric score points 


If Yes, recommend a passing standard that includes no more than 
of . (Example: No more than 1 individual rubric score points of “1”’) 


Cycle 2: 


1) Think about a teacher candidate who is just at the level of knowledge and skills required to 
perform effectively the job of a new teacher in California public schools. 


What total score (the sum of all rubric scores) of the CalTPA Cycle 2 represents the level of 
performance achieved by this individual? 


Cycle 2 
2) Given the committee-recommended passing standard, what (if any) additional condition(s) should be 
applied? 


Apply additional condition?: Yes No 


If Yes, recommend a passing standard that includes no more than individual rubric score points 
of . (Example: No more than | individual rubric score points of “1”") 


Printed Name Institution/Affiliation 


Signature Date 
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TPE 1: 
Engaging and 
Supporting All 
Students in 
Learning 


Element 


1.8. Monitor 
student learning 
and adjust 
instruction while 
teaching so that 
students continue 
to be actively 
engaged in 
learning. 


Chapter 7. Appendices 


Appendix 7.A: Common Scoring Rubric 


No or minimal evidence of 
monitoring of student 
learning; AND no or 
minimal evidence of 
adjusting of instruction. 


* Candidate loosely 
monitors students’ learning 
and/or monitors students’ 
learning of lower-order 
concepts (memorize, 
duplicate, repeat, define) 
about the content being 
taught, thereby 
contributing to a shallow 
understanding of students’ 
understanding of the 
learning goals. 

* Monitoring is insufficient 
to inform appropriate 
adjustments to instruction 
and thus adjustments are 
limited in their usefulness 
for advancing student 
learning. 


Score Level 


* Candidate actively 
monitors students’ learning 
of higher-order concepts 
(analysis, synthesis, 
evaluation, interpretation, 
transfer) throughout the 
lesson, thereby contributing 
to a deeper understanding 
of students’ understanding 
of the learning goals. 

* Adjustments are 
appropriately based on 
information learned from 


monitoring student learning. 


* Adjustments are applied 
in-the-moment to adjust 
instruction for the whole 
Class. 


All of Level 3, plus: 
* Candidate monitors 
learning for 
individual learners 
and differentiates 
instruction to 
address needs of 
specific students. 

* Candidate provides 
adaptations or 
accommodations for 
specific students to 
meet their unique 
learning needs. 


Level 5 


All of Levels 3 & 4, 
plus: 

* Candidate's 
differentiated 
instruction and 
provision of 
adaptations or 
accommodations 
yields opportunities 
for inclusion for all 
students to 
participate in the 
learning community 
and facilitate their 
own learning. 
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TPE 2: Creating 
and Maintaining 
Effective 
Environments 
for Student 
Learning 


Element 


2.5. Maintain high 
expectations for 
learning with 
appropriate 
support for the full 
range of students 
in the classroom. 


Level 1 


* No discussion or 


inclusion of high 
expectations in the lesson 
plan, 
commentaries/reflections, 
or videos of teaching 
practice. 


* Expectations are 
minimally addressed by 
the candidate, and there is 
limited or weak evidence 
of how expectations are 
maintained. 

* Candidate provides some 
discussion and/or 
evidence for implementing 
supports (e.g., adaptations 
and accommodations) to 
help students attain 
expectations, but supports 
do not address the full 
range of learners in the 
class. 


Score Level 


* High expectations for 
student learning are evident 
in lesson plan(s) and 
instruction. 

* Expectations are 
revisited--as opposed to a 
singular reference--and 
progress in meeting 
expectations is monitored 
and adjusted, as needed, to 
ensure that expectations 
remain high. 

* To help ensure that 
students can meet the high 
expectations, the candidate 
effectively uses supports 
(e.g. adaptations and 
accommodations) that are 
appropriate for the full 
range of learners. 


All of 3, plus: 

* Candidate provides 
a clear rationale for 
how they (a) identify 
expectations, (b) 
monitor progress in 
meeting those 
expectations, and (c) 
identify 
individualized 
supports to help 
students meet 
expectations. 


Level 5 


All of 3 & 4, plus: 
* Candidate 
demonstrates an 
intentional focus on 
flexible learning 
environments that 
support all students 
and allows for all 
students to 
participate in the 
learning community 
and facilitate their 
own learning. 
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TPE 3: 
Understanding 
and Organizing 
Subject Matter 
for Student 
Learning 


Element 


3.1. Demonstrate 
knowledge of 
subject matter, 
including the 
adopted California 
State Standards 
and curriculum 
frameworks. 


Level 1 


Candidate demonstrates 
limited and weak 
evidence of his/her 
knowledge of the subject 
matter, California State 
Standards, and 
curriculum frameworks 
(e.g., use of incorrect 
academic language, 
inability to answer student 
questions due to limited 
content knowledge, 
lesson plans or 
instructional strategies 
that are not grade-level 
appropriate). 


Level 2 


* Lesson plan(s) includes 
content and activities or 
Strategies that are loosely 
or vaguely aligned with 
appropriate grade-level 
content standards. 

* Instruction includes 
content and activities or 
Strategies that are loosely 
or vaguely aligned with 
appropriate grade-level 
content standards. 

* Candidate sometimes 
uses appropriate academic 
language during instruction 
and in analysis of student 
work, but not always. 

* Candidate demonstrates, 
through submitted 
evidence (e.g., lesson 
plan, video, analysis of 
student work), basic 
understanding of the 
subject matter and 
curriculum frameworks, but 
limited provision of 
scaffolds, representations, 
and/or modeling to 
advance student learning. 


Score Level 


* Lesson plan(s) includes 
content and activities or 
Strategies that are clearly 
aligned with appropriate 
grade-level content 
standards. 

* Instruction includes 
content and activities or 
Strategies that are clearly 
aligned with appropriate 
grade-level content 
standards. 

* Candidate regularly uses 
appropriate academic 
language during instruction 
and in analysis of student 
work. 

* Candidate demonstrates, 
through submitted evidence 
(e.g., lesson plan, video, 
analysis of student work), 
sufficient understanding of 
the subject matter and 
curriculum frameworks to 
identify scaffolds, 
representations, and/or 
modeling to advance 
student learning. 


Level 4 


Level 3, plus: 

* Checks for student 
understanding of 
academic language 
during lessons. 

* Content-specific 
strategies, such as 
modeling and 
scaffolding, are used 
to advance student 
learning. 


Level 5 


Level 3 & 4, plus: 

* Candidate connects 
knowledge of subject 
matter to practical 
applications/real 
world topics that are 
relatable to students 
with varying learning 
needs. 
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TPE 3: 
Understanding 
and Organizing 
Subject Matter 
for Student 
Learning 


Element 


3.2. Use 
knowledge about 
students and 
learning goals to 
organize the 
curriculum to 
facilitate student 
understanding of 
subject matter and 
make 
accommodations 
andlor 
modifications as 
needed to promote 
student access to 
the curriculum. 


Level 1 


* Candidate's approach to 
organizing the curriculum 
is a one plan fits all" 
approach. 

* No accommodations 
and/or modifications. OR, 
if used, are used 
inappropriately. 


Level 2 


* Candidate's knowledge 
of their students is not 
Clear in the lesson plan 
(e.g., few or weak 
connections between 
students’ prior knowledge 
and learning goals) and/or 
their instructional 
strategies and activities. 

* Accommodations and/or 
modifications are not 
adequately informed by 
knowledge of students and 
thereby fall short of 
promoting student access 
to the curriculum. 


Score Level 


* Candidate uses 
knowledge of students 
(e.g., learning needs, 
backgrounds, interests) to 
design lesson plan(s) that 
include specific 
instructional strategies and 
activities that promote 
access to the curriculum. 

* Candidate sets learning 
goals that build on students’ 
prior knowledge. 

* Candidate makes 
adjustments to instruction 
that are informed by prior 
knowledge of the students. 
* Candidate implements 
adaptations and 
accommodations that are 
tailored to the specific 
needs of the students in 
this class and promote 
access to curriculum. 


All of 3, plus: 

* Lesson planning 
and instruction are 
informed by 
knowledge of both 
whole group and 
specific students. 

* Candidate's lesson 
plan(s) provides 
detailed explanation 
of why the proposed 
instructional 
approach (e.g., 
adaptations, 
accommodations, 
modifications) is 
appropriate for 
supporting specific 
students. 


Level 5 


All of 3 & 4, plus: 

* Candidate's 
instructional 
approach (e.g., 
adaptations, 
accommodations, 
modifications) are 
evidence-based 
and/or supported by 
principles from 
research and/or 
theory. 

* Candidate's 
planning and 
instruction are 
flexible and 
responsive to the 
needs of the 
students. 

* Candidate's 
planning and 
instructing contribute 
to a classroom 
environment in which 
all students feel 
equally valued. 


qe 
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TPE 3: 
Understanding 
and Organizing 
Subject Matter 
for Student 
Learning 


Element 


3.5. Adapt subject 
matter curriculum, 
organization, and 
planning to 
support the 
acquisition and 
use of academic 
language within 
learning activities 
to promote the 
subject matter 
knowledge of all 
students, including 
the full range of 
English learners, 
Standard English 
learners, students 
with disabilities, 
and students with 
other learning 
needs in the least 
restrictive 
environment. 


Level 1 


* Candidate does not 
include plans or learning 
activities to promote 
students’ acquisition of 
academic language. 

* Instruction fails to use or 
demonstrates inadequate 
use of adaptations or 
accommodations to 
support diverse learners’ 
acquisition of academic 
language. 


Level 2 


* Candidate loosely or 
superficially ties academic 
language to lesson plans 
and/or instructional 
activities (i.e., not a clear 
connection to the 
academic language and 
the topic of instruction). 

* Adaptations or 
accommodations to 
support acquisition of 
academic language are 
connected to some, but 
not all, student groups in 
this class. 


Score Level 


* Candidate plans for and 
uses learning activities that 
provide opportunities for 
students to acquire and use 
academic language. 

* Candidate uses academic 
language in a way that 
promotes and deepens 
students’ understanding of 
the subject matter. 

* Access to academic 
language is promoted 
through instructional 
adaptations or 
accommodations that 
support learning for all 
students, including the full 
range of English learners, 
Standard English learners, 
students with disabilities, 
and students with other 
learning needs. 


Level 4 


All of 3, plus: 

* There is clear 
evidence of the 
candidate 
differentiating 
instruction, through 
adaptations or 
accommodations, to 
promote acquisition 
of academic 
language for diverse 
learners in the class. 


Level 5 


All of 3 & 4, plus: 

* Candidate's use of 
adaptations and/or 
accommodations to 
support academic 
language acquisition 
are evidence-based 
and developmentally 
appropriate, which 
contributes to a 
classroom 
environment where 
all students feel 
equally valued. 
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TPE 4: Planning 
Instruction and 
Designing 
Learning 
Experiences for 
All Students 


Element 


4.1. Locate and 
apply information 
about students’ 
current academic 
status, content- and 
standards-related 
learning needs and 
goals, assessment 
data, language 
proficiency status, 
and cultural 
background for both 
short-term and long- 
term instructional 
planning purposes. 


Level 1 


* Itis not clear how or if 
the candidate located 
information about 
students’ background. 

* No evidence of the 
candidate applying 
background information 
about students to their 
short-term or long-term 
instructional planning. 


Level 2 Level 3 


* Candidate's efforts to 
gather background 
information about students 
reflect a minimal level of 
effort (e.g., consulting a 
single source, such as last 
year's test scores). 

* The connection between 
student background 
information and its 
application to instructional 
planning is unclear or 
weak. 

* Candidate applies 
information about students 
to short-term planning, but 
no evidence of using that 
information for long-term 
instructional planning 
purposes (i.¢., beyond the 
next couple of lessons). 


Score Level 


* Candidate gathers 
adequate amount of 
information about students’ 
background (academic and 
non-academic information) 
from multiple sources (e.g., 
assessment data, student 
records, discussion with 
prior teachers, discussions 
with students). 

* Candidate clearly applies 
that background 
information to instructional 
planning, both short-term 
and long-term (i.e., beyond 


the next couple of lessons). 


Level 4 


All of level 3, plus: 
* Candidate provides 
rationale for how the 
information he/she 
gathered was used 
to make decisions 
for short-term and 
long-term 
instructional 
planning. 


Level 5 


All of 3 and 4, plus: 


* Candidate makes 
clear reference to 
how they 
individualized short- 
term and long-term 
planning based on 
the full range of 
learners in the 
classroom. 

* Candidate's 
instructional plans 
are supported by 
evidence-based 
research and/or 
principles from 
research and/or 
theory. 
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TPE 5: 
Assessing 
Student 
Learning 


Element 


1. Apply 
knowledge of the 
purposes, 
characteristics, 
and appropriate 
uses of different 
types of 
assessments (e.g., 
diagnostic, 
informal, formal, 
progress- 
monitoring, 
formative, 
summative, and 
performance) to 
design and 
administer 
classroom 
assessments, 
including use of 
scoring rubrics. 


* Candidate does not 
demonstrate knowledge 
of multiple assessments 
and their appropriate 
uses. 

* Assessment(s) and 
scoring rubrics are poorly 
aligned to the learning 
goals. 


Level 2 


* Candidate demonstrates 
knowledge of only one 
type of assessment. 

* Candidate demonstrates 
limited understanding of 
the connection between 
assessment purpose and 
learning goals. 

* Assessment(s) and 
scoring rubrics are loosely 
aligned to the learning 
goals. 

* Candidate makes one or 
more errors in designing, 
administering and/or 
scoring assessments. 


Score Level 


* Candidate demonstrates 
knowledge of more than 
one type of assessment. 

* Candidate demonstrates 
understanding of the 
connection between 
assessment purpose and 
learning goals. 

* Assessments and/or 
scoring rubrics are aligned 
to the learning goals. 

* Candidate demonstrates 
ability to design, administer 
and score a variety of 
assessments. 

* Candidate appropriately 
administers assessments 
and accurately applies 
scoring rubrics. 


Level 4 


All of 3, plus: 

* Through his/her 
effective use of 
assessments, 
candidate 
demonstrates 
knowledge of the 
purposes, 
characteristics, and 
appropriate uses of 
different types of 
assessment. 

* Candidate 
demonstrates the 
ability to design 
effective informal 
and/or progress- 
monitoring 
assessments. 

* Appropriate 
prompts, directions, 
and criteria for 
meeting the learning 
outcomes are 
provided to students. 


Level 5 


All of 3 & 4, plus: 

* Assessments are 
purposefully used to 
advance or deepen 
learning. 

* Candidate 
evaluates and 
justifies how the 
assessments align to 
the learning goals. 

* Candidate provides 
assessments that 
allow for multiple 
pathways for 
students to 
demonstrate their 
learning. 


seoipuaddy : |] BuINjOA — S[apOW Wd_L JO Ayigqesedwioy jo uoljebijsanu] 


CLLWL 


TPE 5: 
Assessing 
Student 
Learning 


5.2. Collect and 
analyze assessment 
data from multiple 
measures and 
sources to plan and 
modify instruction 
and document 
students’ learning 
over time. 


Level 1 


* Candidate does not 
collect and analyze data, 
or collects and analyzes 
data from a single 
measure. 

* Candidate demonstrates 
little to no connection 
between results from 
assessment and 
modifications to 
instruction. 

* Candidate fails to 
document students’ 
learning over time. 


* Candidate collects and 
analyzes data from more 
than one measure, but the 
body of evidence is limited 
and does not support 
strong conclusions about 
student learning. 

* Modifications to 
instruction are based on 
tenuous conclusions 
drawn from a limited body 
of assessment data. 

* Weak documentation of 


student learning over time. 


Score Level 


* Candidate uses 
assessment data from 
multiple measures and 
sources and uses the body 
of evidence to make 
changes to their plans and 
instruction. 

* Candidate accurately 
analyzes assessment data 
and uses results to make 
appropriate modifications to 
his/her instruction. 

* Candidate uses 
assessment data from 
multiple measures to 
document students’ 
learning over time. 


All of 3, plus: 

* Candidate provides 
clear rationale and 
justification for the 
assessments he/she 
used and how 
he/she used the 
assessment data to 
plan and modify 
instruction. 

* Candidate 
describes use of 
information on 
student learning to 
make targeted, as 
well as class wide, 
changes to 
instruction. 

* Candidate explains 
how he/she 
documents students’ 
learning and how 
he/she uses 
assessment data 
and other 
information sources 
to track learning over 
time. 


Level 5 


All of 3 & 4, plus: 

* Candidate explains 
how assessments 
and other information 
sources can be 
improved, either by 
capturing additional 
evidence of student 
learning and/or 
eliminating the 
capture of 
uninformative data. 
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ELLWL 


TPE 6: 
Developing as a 
Professional 
Educator 


Element 


6.1. Reflect on 
their own teaching 
practice and level 
of subject matter 
and pedagogical 
knowledge to plan 
and implement 
instruction that 
can improve 
student learning. 


Level 1 


* Candidate's reflections 
about the (a) 
effectiveness of his/her 
teaching practice, (b) 
level of subject matter 
knowledge and/or (c) 
level of pedagogical 
knowledge are absent or 
contain some 
inaccuracies. 

* Candidate does not 
connect reflections to 
adjustments (e.g., follow- 
up activities) to improve 
student learning. 


Level 2 


* Candidate's reflections 
about the (a) effectiveness 
of his/her teaching 
practice, (b) level of 
subject matter knowledge 
and/or (c) level of 
pedagogical knowledge 
represent a shallow level 
of analysis. 

* Candidate makes vague 
or superficial connections 
between his/her reflections 
and planned adjustments 
to improve student 
learning. 


Score Level 


* Candidate adequately 
reflects on the 
effectiveness of their lesson 
plan--from both a pedagogy 
and content perspective-- 
and implements (or 
discusses plans to 
implement) adjustments to 
improve student learning. 
* Candidate adequately 
reflects on the 
effectiveness of their 
instructional strategies 
and/or activities--from both 
a pedagogy and content 
perspective-- and 
implements (or discusses 
plans to implement) 
adjustments to improve 
student learning. 
*Candidate adequately 
reflects on the 
effectiveness of their 
assessments (formal and 
informal) and implements 
(or discusses plans to 
implement) adjustments to 
improve student learning. 
* Candidate's reflections 
include connections to the 
particular learning needs of 
the students in their class. 


Level 4 


All of 3, plus: 

* Candidate provides 
rationale for 
reflections and 
includes 
justifications for 
adjustments. 

* Candidate includes 
explicit focus on 
differentiating 
adjustments for 
specific learners, 
showing 
responsiveness and 
flexibility in his/her 
teaching practice. 


Level 5 


All of 3 & 4, plus: 

* Candidate provides 
clear rationale for all 
reflections and 
includes justifications 
for most/all 
adjustments. 

* Candidate makes 
astute connections 
among the cyclical 
relationship between 
planning, instructing 
and assessing. 
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Table 7.B.1. Common Rubric and TPA Model Polychoric Correlations at Rubric Level (CalTPA) 
CalTPA Rubrics 


Appendix 7.B: Common Rubric and Model Rubric Correlations (TPE Element Level) 


(Ss) 
5 = = = = = = = = N N N N N “ N N N 
sc | | | | | | | | | | | | | | | | | 
elie ee lees ee > Wall) cee HN ee NN) coca Sed) ead es Nl lps ieee ll apa] eli 
5 o iro) ire) ire) ire) ire) ire) iro) ire) ire) iro) ire) ire) iro) ire) ire) ire) ire) 
eu ¢ id id w id id x id id rd id id w id ee id 
ee 
Or 
1.8 19 22 
2.5 46 42 
3.1 .03 -.10 -.07 .20 10 
3.2 27 29 44 55 58 46 21 
3.5 .64 59 38 56 48 .60 
4.1 -.08 37 -50 58 
5.1 23 -.12 22 
5.2 .20 .34 .38 13 12 .60 
6.1 .29 21 .39 


Note. Because the rubrics are rated on ordinal scales, polychoric correlations are reported. 
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Note. Because the rubrics are rated on ordinal scales, polychoric correlations are reported. 
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